2024-03-21T13:05:41.618 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T13:05:41.618 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_gabrioux@teuthology --name gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi --verbose --description orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} --archive /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993 -- /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/orig.config.yaml 2024-03-21T13:05:41.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:05:41.721 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993 branch: wip-guits-testing-2024-03-21-0818 description: orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} email: gabrioux@ibm.com first_in_suite: false job_id: '7614993' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-guits-testing-2024-03-21-0818 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 960fbbe4645c2becc8084669be194c95183c7753 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 960fbbe4645c2becc8084669be194c95183c7753 workunit: branch: wip-guits-testing-2024-03-21-0818 sha1: 960fbbe4645c2becc8084669be194c95183c7753 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - - host.b - client.1 seed: 187 sha1: 960fbbe4645c2becc8084669be194c95183c7753 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-testing-2024-03-21-0818 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_960fbbe4645c2becc8084669be194c95183c7753/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 960fbbe4645c2becc8084669be194c95183c7753 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkgtbdm8AHLG0deIjmwT8wcSMxNx13Xr4FwPVu6l0sFDGF4VlyB8nGetijHW7PPrH5Cir8+m4EBpeBalwuuejg= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCiYO9FrwthJrpPsJ2UAsW7bbQoQdpWAer4nQQ+BA2Db6ucr1LbmxmGP+oDcvRDHuUgBnoj7tKia4WckmIiZW1o= tasks: - nvme_loop: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - vip.exec: all-hosts: - systemctl stop nfs-server - cephadm.shell: host.a: - ceph nfs cluster create foo - cephadm.wait_for_service: service: nfs.foo - cephadm.shell: host.a: - stat -c '%u %g' /var/log/ceph | grep '167 167' - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls | grep '^osd.all-available-devices ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-21_12:04:17 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-21T13:05:41.722 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_960fbbe4645c2becc8084669be194c95183c7753/qa; will attempt to use it 2024-03-21T13:05:41.723 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_960fbbe4645c2becc8084669be194c95183c7753/qa/tasks 2024-03-21T13:05:41.723 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-21T13:05:41.724 INFO:teuthology.task.internal:Checking packages... 2024-03-21T13:05:41.750 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '960fbbe4645c2becc8084669be194c95183c7753' 2024-03-21T13:05:41.750 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-21T13:05:41.750 INFO:teuthology.packaging:ref: None 2024-03-21T13:05:41.750 INFO:teuthology.packaging:tag: None 2024-03-21T13:05:41.750 INFO:teuthology.packaging:branch: wip-guits-testing-2024-03-21-0818 2024-03-21T13:05:41.750 INFO:teuthology.packaging:sha1: 960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:05:41.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-guits-testing-2024-03-21-0818 2024-03-21T13:05:41.895 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2267-g960fbbe4-1jammy 2024-03-21T13:05:41.897 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-21T13:05:41.905 INFO:teuthology.task.internal:no buildpackages task found 2024-03-21T13:05:41.905 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-21T13:05:41.917 INFO:teuthology.task.internal:Saving configuration 2024-03-21T13:05:41.929 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-21T13:05:41.940 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T13:05:41.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 12:58:12.979194', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDKJ0atN3mIufa+tCbVv+VEs1djmUB1pdYFuNXbkwqHQ'} 2024-03-21T13:05:41.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 12:58:12.977309', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIph+MM7XjHcZNRwlWK9OESUTE2KhzVOKPR5PpdWLs3h'} 2024-03-21T13:05:41.985 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-21T13:05:41.996 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['host.a', 'client.0'] 2024-03-21T13:05:41.996 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['host.b', 'client.1'] 2024-03-21T13:05:41.996 INFO:teuthology.run_tasks:Running task console_log... 2024-03-21T13:05:42.072 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e69dbc3a0>, signals=[15]) 2024-03-21T13:05:42.073 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-21T13:05:42.080 INFO:teuthology.task.internal:Opening connections... 2024-03-21T13:05:42.080 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:05:42.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:05:42.167 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-03-21T13:05:42.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:05:42.247 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-21T13:05:42.255 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-03-21T13:05:42.260 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-03-21T13:05:42.261 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-21T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-21T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2024-03-21T13:05:42.308 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="22.04" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=jammy 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-21T13:05:42.309 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=jammy 2024-03-21T13:05:42.310 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-21T13:05:42.334 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-03-21T13:05:42.338 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-03-21T13:05:42.338 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-03-21T13:05:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-21T13:05:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Ubuntu" 2024-03-21T13:05:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="22.04" 2024-03-21T13:05:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-21T13:05:42.388 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_CODENAME=jammy 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:ID=ubuntu 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE=debian 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-21T13:05:42.389 INFO:teuthology.orchestra.run.smithi157.stdout:UBUNTU_CODENAME=jammy 2024-03-21T13:05:42.389 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-03-21T13:05:42.408 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-21T13:05:42.418 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-21T13:05:42.426 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-21T13:05:42.426 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-03-21T13:05:42.429 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-03-21T13:05:42.435 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-21T13:05:42.443 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-21T13:05:42.443 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-03-21T13:05:42.474 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-03-21T13:05:42.488 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-21T13:05:42.546 INFO:teuthology.run_tasks:Running task kernel... 2024-03-21T13:05:42.563 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-21T13:05:42.564 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-21T13:05:42.564 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-21T13:05:42.564 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-21T13:05:42.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:05:42.569 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-03-21T13:05:42.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:05:42.570 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-03-21T13:05:42.616 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-56-generic 2024-03-21T13:05:42.617 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.15.0-56-generic 2024-03-21T13:05:42.617 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-03-21T13:05:42.618 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-56-generic 2024-03-21T13:05:42.618 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.15.0-56-generic 2024-03-21T13:05:42.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get clean 2024-03-21T13:05:42.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-03-21T13:05:42.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-03-21T13:05:42.898 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-21T13:05:42.929 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-21T13:05:42.990 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-21T13:05:43.023 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-21T13:05:43.023 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-21T13:05:43.024 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-21T13:05:43.076 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-21T13:05:43.167 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [594 kB] 2024-03-21T13:05:43.297 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,502 kB] 2024-03-21T13:05:43.388 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [289 kB] 2024-03-21T13:05:43.397 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-21T13:05:43.398 INFO:teuthology.orchestra.run.smithi005.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,619 kB] 2024-03-21T13:05:43.423 INFO:teuthology.orchestra.run.smithi005.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,286 kB] 2024-03-21T13:05:43.429 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-21T13:05:43.430 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [428 kB] 2024-03-21T13:05:43.455 INFO:teuthology.orchestra.run.smithi005.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-21T13:05:43.455 INFO:teuthology.orchestra.run.smithi005.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [271 kB] 2024-03-21T13:05:43.467 INFO:teuthology.orchestra.run.smithi005.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-21T13:05:43.468 INFO:teuthology.orchestra.run.smithi005.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [697 kB] 2024-03-21T13:05:43.485 INFO:teuthology.orchestra.run.smithi005.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,059 kB] 2024-03-21T13:05:43.504 INFO:teuthology.orchestra.run.smithi005.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [240 kB] 2024-03-21T13:05:43.526 INFO:teuthology.orchestra.run.smithi005.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-21T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-21T13:05:43.527 INFO:teuthology.orchestra.run.smithi005.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-21T13:05:43.528 INFO:teuthology.orchestra.run.smithi005.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-21T13:05:43.528 INFO:teuthology.orchestra.run.smithi005.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-21T13:05:43.529 INFO:teuthology.orchestra.run.smithi005.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-21T13:05:43.530 INFO:teuthology.orchestra.run.smithi005.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-21T13:05:43.544 INFO:teuthology.orchestra.run.smithi005.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-21T13:05:43.545 INFO:teuthology.orchestra.run.smithi005.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-21T13:05:43.565 INFO:teuthology.orchestra.run.smithi005.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-21T13:05:43.565 INFO:teuthology.orchestra.run.smithi005.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-21T13:05:43.566 INFO:teuthology.orchestra.run.smithi005.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-21T13:05:43.566 INFO:teuthology.orchestra.run.smithi005.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-21T13:05:43.569 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [594 kB] 2024-03-21T13:05:43.717 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,286 kB] 2024-03-21T13:05:43.765 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,502 kB] 2024-03-21T13:05:43.825 INFO:teuthology.orchestra.run.smithi005.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [428 kB] 2024-03-21T13:05:43.843 INFO:teuthology.orchestra.run.smithi005.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [229 kB] 2024-03-21T13:05:43.853 INFO:teuthology.orchestra.run.smithi005.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-21T13:05:43.854 INFO:teuthology.orchestra.run.smithi005.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-21T13:05:43.855 INFO:teuthology.orchestra.run.smithi005.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,591 kB] 2024-03-21T13:05:43.883 INFO:teuthology.orchestra.run.smithi157.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [229 kB] 2024-03-21T13:05:43.895 INFO:teuthology.orchestra.run.smithi157.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-21T13:05:43.896 INFO:teuthology.orchestra.run.smithi157.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,591 kB] 2024-03-21T13:05:43.912 INFO:teuthology.orchestra.run.smithi157.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [289 kB] 2024-03-21T13:05:43.931 INFO:teuthology.orchestra.run.smithi157.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-21T13:05:43.932 INFO:teuthology.orchestra.run.smithi157.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,619 kB] 2024-03-21T13:05:43.946 INFO:teuthology.orchestra.run.smithi005.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [267 kB] 2024-03-21T13:05:43.957 INFO:teuthology.orchestra.run.smithi005.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-21T13:05:43.957 INFO:teuthology.orchestra.run.smithi005.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [851 kB] 2024-03-21T13:05:43.977 INFO:teuthology.orchestra.run.smithi157.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-21T13:05:43.978 INFO:teuthology.orchestra.run.smithi157.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [267 kB] 2024-03-21T13:05:43.988 INFO:teuthology.orchestra.run.smithi005.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-21T13:05:44.067 INFO:teuthology.orchestra.run.smithi157.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-21T13:05:44.068 INFO:teuthology.orchestra.run.smithi157.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-21T13:05:44.068 INFO:teuthology.orchestra.run.smithi157.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [599 kB] 2024-03-21T13:05:44.068 INFO:teuthology.orchestra.run.smithi157.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [271 kB] 2024-03-21T13:05:44.073 INFO:teuthology.orchestra.run.smithi157.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-21T13:05:44.078 INFO:teuthology.orchestra.run.smithi157.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [851 kB] 2024-03-21T13:05:44.165 INFO:teuthology.orchestra.run.smithi005.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-21T13:05:44.237 INFO:teuthology.orchestra.run.smithi157.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,059 kB] 2024-03-21T13:05:44.256 INFO:teuthology.orchestra.run.smithi157.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-21T13:05:44.571 INFO:teuthology.orchestra.run.smithi005.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-21T13:05:44.577 INFO:teuthology.orchestra.run.smithi005.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-21T13:05:44.591 INFO:teuthology.orchestra.run.smithi005.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-21T13:05:44.592 INFO:teuthology.orchestra.run.smithi005.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-21T13:05:44.594 INFO:teuthology.orchestra.run.smithi005.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-21T13:05:44.653 INFO:teuthology.orchestra.run.smithi157.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-21T13:05:44.659 INFO:teuthology.orchestra.run.smithi157.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-21T13:05:44.673 INFO:teuthology.orchestra.run.smithi157.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-21T13:05:44.674 INFO:teuthology.orchestra.run.smithi157.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-21T13:05:44.676 INFO:teuthology.orchestra.run.smithi157.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-21T13:05:44.870 INFO:teuthology.orchestra.run.smithi157.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [697 kB] 2024-03-21T13:05:44.908 INFO:teuthology.orchestra.run.smithi157.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [240 kB] 2024-03-21T13:05:44.921 INFO:teuthology.orchestra.run.smithi157.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-21T13:05:44.923 INFO:teuthology.orchestra.run.smithi157.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-21T13:05:44.924 INFO:teuthology.orchestra.run.smithi157.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-21T13:05:44.925 INFO:teuthology.orchestra.run.smithi157.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-21T13:05:44.925 INFO:teuthology.orchestra.run.smithi157.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-21T13:05:44.926 INFO:teuthology.orchestra.run.smithi157.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-03-21T13:05:44.953 INFO:teuthology.orchestra.run.smithi157.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-03-21T13:05:44.956 INFO:teuthology.orchestra.run.smithi157.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-03-21T13:05:45.120 INFO:teuthology.orchestra.run.smithi157.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-21T13:05:45.203 INFO:teuthology.orchestra.run.smithi157.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-03-21T13:05:45.288 INFO:teuthology.orchestra.run.smithi157.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-03-21T13:05:45.367 INFO:teuthology.orchestra.run.smithi157.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-03-21T13:05:45.407 INFO:teuthology.orchestra.run.smithi157.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-21T13:05:49.324 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 12.5 MB in 2s (6,426 kB/s) 2024-03-21T13:05:49.924 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 12.5 MB in 3s (4,797 kB/s) 2024-03-21T13:05:50.587 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-03-21T13:05:50.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-21T13:05:50.657 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-03-21T13:05:50.835 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-03-21T13:05:50.836 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-03-21T13:05:50.993 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-03-21T13:05:50.993 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-21T13:05:50.993 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-21T13:05:50.993 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-21T13:05:50.993 INFO:teuthology.orchestra.run.smithi005.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-21T13:05:50.994 INFO:teuthology.orchestra.run.smithi005.stdout: python2.7-minimal 2024-03-21T13:05:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-21T13:05:50.994 INFO:teuthology.orchestra.run.smithi005.stdout:The following additional packages will be installed: 2024-03-21T13:05:50.994 INFO:teuthology.orchestra.run.smithi005.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-21T13:05:50.995 INFO:teuthology.orchestra.run.smithi005.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-21T13:05:50.995 INFO:teuthology.orchestra.run.smithi005.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-21T13:05:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:Suggested packages: 2024-03-21T13:05:50.996 INFO:teuthology.orchestra.run.smithi005.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-21T13:05:50.996 INFO:teuthology.orchestra.run.smithi005.stdout:Recommended packages: 2024-03-21T13:05:50.997 INFO:teuthology.orchestra.run.smithi005.stdout: thermald 2024-03-21T13:05:51.037 INFO:teuthology.orchestra.run.smithi005.stdout:The following NEW packages will be installed: 2024-03-21T13:05:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-21T13:05:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-21T13:05:51.038 INFO:teuthology.orchestra.run.smithi005.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-21T13:05:51.039 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages will be upgraded: 2024-03-21T13:05:51.039 INFO:teuthology.orchestra.run.smithi005.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-21T13:05:51.098 INFO:teuthology.orchestra.run.smithi005.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-03-21T13:05:51.098 INFO:teuthology.orchestra.run.smithi005.stdout:Need to get 113 MB of archives. 2024-03-21T13:05:51.098 INFO:teuthology.orchestra.run.smithi005.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-21T13:05:51.098 INFO:teuthology.orchestra.run.smithi005.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-21T13:05:51.272 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-03-21T13:05:51.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-21T13:05:51.381 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-03-21T13:05:51.556 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-03-21T13:05:51.556 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-03-21T13:05:51.688 INFO:teuthology.orchestra.run.smithi005.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-21T13:05:51.707 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-03-21T13:05:51.707 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-21T13:05:51.707 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-21T13:05:51.708 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-21T13:05:51.708 INFO:teuthology.orchestra.run.smithi157.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-21T13:05:51.708 INFO:teuthology.orchestra.run.smithi157.stdout: python2.7-minimal 2024-03-21T13:05:51.708 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-21T13:05:51.709 INFO:teuthology.orchestra.run.smithi157.stdout:The following additional packages will be installed: 2024-03-21T13:05:51.709 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-21T13:05:51.709 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-generic linux-image-5.15.0-101-generic 2024-03-21T13:05:51.709 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-5.15.0-101-generic linux-modules-extra-5.15.0-101-generic 2024-03-21T13:05:51.711 INFO:teuthology.orchestra.run.smithi157.stdout:Suggested packages: 2024-03-21T13:05:51.711 INFO:teuthology.orchestra.run.smithi157.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-21T13:05:51.711 INFO:teuthology.orchestra.run.smithi157.stdout:Recommended packages: 2024-03-21T13:05:51.711 INFO:teuthology.orchestra.run.smithi157.stdout: thermald 2024-03-21T13:05:51.759 INFO:teuthology.orchestra.run.smithi157.stdout:The following NEW packages will be installed: 2024-03-21T13:05:51.759 INFO:teuthology.orchestra.run.smithi157.stdout: linux-headers-5.15.0-101 linux-headers-5.15.0-101-generic 2024-03-21T13:05:51.759 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.15.0-101-generic linux-modules-5.15.0-101-generic 2024-03-21T13:05:51.759 INFO:teuthology.orchestra.run.smithi157.stdout: linux-modules-extra-5.15.0-101-generic 2024-03-21T13:05:51.760 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages will be upgraded: 2024-03-21T13:05:51.761 INFO:teuthology.orchestra.run.smithi157.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-21T13:05:51.871 INFO:teuthology.orchestra.run.smithi005.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-21T13:05:51.939 INFO:teuthology.orchestra.run.smithi157.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-03-21T13:05:51.939 INFO:teuthology.orchestra.run.smithi157.stdout:Need to get 113 MB of archives. 2024-03-21T13:05:51.939 INFO:teuthology.orchestra.run.smithi157.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-21T13:05:51.940 INFO:teuthology.orchestra.run.smithi157.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-101-generic amd64 5.15.0-101.111 [22.6 MB] 2024-03-21T13:05:53.010 INFO:teuthology.orchestra.run.smithi005.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-21T13:05:53.010 INFO:teuthology.orchestra.run.smithi005.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-21T13:05:53.010 INFO:teuthology.orchestra.run.smithi005.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-21T13:05:53.275 INFO:teuthology.orchestra.run.smithi005.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-21T13:05:53.328 INFO:teuthology.orchestra.run.smithi157.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-101-generic amd64 5.15.0-101.111 [11.5 MB] 2024-03-21T13:05:53.340 INFO:teuthology.orchestra.run.smithi005.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-21T13:05:53.683 INFO:teuthology.orchestra.run.smithi157.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-101-generic amd64 5.15.0-101.111 [63.9 MB] 2024-03-21T13:05:53.768 INFO:teuthology.orchestra.run.smithi005.stdout:Fetched 113 MB in 2s (49.3 MB/s) 2024-03-21T13:05:53.950 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-21T13:05:55.886 INFO:teuthology.orchestra.run.smithi157.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.101.98 [1,698 B] 2024-03-21T13:05:55.886 INFO:teuthology.orchestra.run.smithi157.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.101.98 [2,486 B] 2024-03-21T13:05:55.887 INFO:teuthology.orchestra.run.smithi157.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101 all 5.15.0-101.111 [12.3 MB] 2024-03-21T13:05:55.905 INFO:teuthology.orchestra.run.smithi005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-21T13:05:55.910 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:05:55.989 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:05:56.654 INFO:teuthology.orchestra.run.smithi157.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-101-generic amd64 5.15.0-101.111 [2,876 kB] 2024-03-21T13:05:56.774 INFO:teuthology.orchestra.run.smithi157.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.101.98 [2,332 B] 2024-03-21T13:05:57.163 INFO:teuthology.orchestra.run.smithi157.stdout:Fetched 113 MB in 5s (22.6 MB/s) 2024-03-21T13:05:57.362 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-5.15.0-101-generic. 2024-03-21T13:05:58.024 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-21T13:05:58.045 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:05:58.144 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:05:58.602 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-21T13:05:58.623 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:05:58.660 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:05:59.385 INFO:teuthology.orchestra.run.smithi157.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-21T13:05:59.389 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../0-linux-modules-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:05:59.526 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:02.111 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-image-5.15.0-101-generic. 2024-03-21T13:06:02.133 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../1-linux-image-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:06:02.226 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:02.715 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-101-generic. 2024-03-21T13:06:02.735 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:06:02.798 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:05.245 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:05.363 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:05.679 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:05.800 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:06.128 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-21T13:06:06.139 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-21T13:06:06.178 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-21T13:06:09.682 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../3-linux-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:09.792 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:10.108 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:10.246 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-image-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:10.565 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-101. 2024-03-21T13:06:10.588 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../5-linux-headers-5.15.0-101_5.15.0-101.111_all.deb ... 2024-03-21T13:06:10.632 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-21T13:06:12.466 INFO:teuthology.orchestra.run.smithi005.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-21T13:06:12.503 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:06:12.541 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:15.229 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:15.353 INFO:teuthology.orchestra.run.smithi005.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:15.687 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-21T13:06:15.808 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:15.934 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-21T13:06:16.063 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:16.778 INFO:teuthology.orchestra.run.smithi157.stdout:Selecting previously unselected package linux-headers-5.15.0-101-generic. 2024-03-21T13:06:16.815 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../6-linux-headers-5.15.0-101-generic_5.15.0-101.111_amd64.deb ... 2024-03-21T13:06:16.853 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:17.443 INFO:teuthology.orchestra.run.smithi005.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:17.443 INFO:teuthology.orchestra.run.smithi005.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:17.443 INFO:teuthology.orchestra.run.smithi005.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:17.443 INFO:teuthology.orchestra.run.smithi005.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:17.616 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:19.358 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:20.549 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.101.98_amd64.deb ... 2024-03-21T13:06:20.655 INFO:teuthology.orchestra.run.smithi157.stdout:Unpacking linux-headers-generic (5.15.0.101.98) over (5.15.0.56.54) ... 2024-03-21T13:06:20.776 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-21T13:06:20.902 INFO:teuthology.orchestra.run.smithi005.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-21T13:06:21.012 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-101 (5.15.0-101.111) ... 2024-03-21T13:06:21.029 INFO:teuthology.orchestra.run.smithi005.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:21.094 INFO:teuthology.orchestra.run.smithi005.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-21T13:06:21.094 INFO:teuthology.orchestra.run.smithi005.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:21.159 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:21.277 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-headers-generic (5.15.0.101.98) ... 2024-03-21T13:06:21.397 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:22.718 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:22.719 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:22.719 INFO:teuthology.orchestra.run.smithi157.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:22.719 INFO:teuthology.orchestra.run.smithi157.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:22.899 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-extra-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:24.333 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-modules-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:26.526 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-image-generic (5.15.0.101.98) ... 2024-03-21T13:06:26.652 INFO:teuthology.orchestra.run.smithi157.stdout:Setting up linux-generic (5.15.0.101.98) ... 2024-03-21T13:06:26.795 INFO:teuthology.orchestra.run.smithi157.stdout:Processing triggers for linux-image-5.15.0-101-generic (5.15.0-101.111) ... 2024-03-21T13:06:26.869 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-21T13:06:26.869 INFO:teuthology.orchestra.run.smithi157.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:35.810 INFO:teuthology.orchestra.run.smithi005.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-21T13:06:35.810 INFO:teuthology.orchestra.run.smithi005.stdout:Sourcing file `/etc/default/grub' 2024-03-21T13:06:35.821 INFO:teuthology.orchestra.run.smithi005.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-21T13:06:35.837 INFO:teuthology.orchestra.run.smithi005.stdout:Generating grub configuration file ... 2024-03-21T13:06:36.097 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:36.120 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:36.387 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:36.393 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:36.463 INFO:teuthology.orchestra.run.smithi005.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-21T13:06:36.468 INFO:teuthology.orchestra.run.smithi005.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-21T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-21T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-21T13:06:36.622 INFO:teuthology.orchestra.run.smithi005.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-21T13:06:36.667 INFO:teuthology.orchestra.run.smithi005.stdout:done 2024-03-21T13:06:37.147 DEBUG:teuthology.orchestra.run.smithi005:> dpkg -s linux-image-generic 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Package: linux-image-generic 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Status: install ok installed 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Priority: optional 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Section: kernel 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Installed-Size: 21 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Maintainer: Ubuntu Kernel Team 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: amd64 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Source: linux-meta 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Version: 5.15.0.101.98 2024-03-21T13:06:37.177 INFO:teuthology.orchestra.run.smithi005.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-21T13:06:37.178 INFO:teuthology.orchestra.run.smithi005.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-21T13:06:37.178 INFO:teuthology.orchestra.run.smithi005.stdout:Recommends: thermald 2024-03-21T13:06:37.178 INFO:teuthology.orchestra.run.smithi005.stdout:Description: Generic Linux kernel image 2024-03-21T13:06:37.178 INFO:teuthology.orchestra.run.smithi005.stdout: This package will always depend on the latest generic kernel image 2024-03-21T13:06:37.178 INFO:teuthology.orchestra.run.smithi005.stdout: available. 2024-03-21T13:06:37.178 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-21T13:06:37.178 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-21T13:06:37.178 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-21T13:06:37.178 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-03-21T13:06:37.179 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-03-21T13:06:37.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get clean 2024-03-21T13:06:37.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo apt-get update 2024-03-21T13:06:37.685 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-21T13:06:37.700 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-21T13:06:37.782 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-21T13:06:37.864 INFO:teuthology.orchestra.run.smithi005.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-21T13:06:39.110 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-03-21T13:06:39.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-21T13:06:39.191 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists... 2024-03-21T13:06:39.391 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree... 2024-03-21T13:06:39.391 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information... 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages were automatically installed and are no longer required: 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-21T13:06:39.551 INFO:teuthology.orchestra.run.smithi005.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-21T13:06:39.552 INFO:teuthology.orchestra.run.smithi005.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-21T13:06:39.552 INFO:teuthology.orchestra.run.smithi005.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-21T13:06:39.591 INFO:teuthology.orchestra.run.smithi005.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-03-21T13:06:39.593 DEBUG:teuthology.orchestra.run.smithi005:> dpkg -s linux-image-generic 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Package: linux-image-generic 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Status: install ok installed 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Priority: optional 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Section: kernel 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Installed-Size: 21 2024-03-21T13:06:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Maintainer: Ubuntu Kernel Team 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: amd64 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Source: linux-meta 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Version: 5.15.0.101.98 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Recommends: thermald 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout:Description: Generic Linux kernel image 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: This package will always depend on the latest generic kernel image 2024-03-21T13:06:39.610 INFO:teuthology.orchestra.run.smithi005.stdout: available. 2024-03-21T13:06:39.611 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-03-21T13:06:39.659 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.yDKFBAEL2u 2024-03-21T13:06:39.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub/grub.cfg /tmp/tmp.yDKFBAEL2u 2024-03-21T13:06:39.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.yDKFBAEL2u 2024-03-21T13:06:39.828 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.yDKFBAEL2u is 10KB 2024-03-21T13:06:39.840 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.yDKFBAEL2u 2024-03-21T13:06:39.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-21T13:06:39.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:06:39.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-21T13:06:39.904 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-21T13:06:39.975 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-21T13:06:39.976 DEBUG:teuthology.orchestra.run.smithi005:> sudo update-grub 2024-03-21T13:06:41.186 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub' 2024-03-21T13:06:41.187 INFO:teuthology.orchestra.run.smithi005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-21T13:06:41.189 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-03-21T13:06:41.228 INFO:teuthology.orchestra.run.smithi157.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-21T13:06:41.228 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub' 2024-03-21T13:06:41.259 INFO:teuthology.orchestra.run.smithi157.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-21T13:06:41.286 INFO:teuthology.orchestra.run.smithi157.stdout:Generating grub configuration file ... 2024-03-21T13:06:41.382 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:41.388 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:41.603 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:41.608 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:41.621 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-21T13:06:41.654 INFO:teuthology.orchestra.run.smithi005.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-21T13:06:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-21T13:06:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-21T13:06:41.785 INFO:teuthology.orchestra.run.smithi005.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-21T13:06:41.817 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-03-21T13:06:41.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-03-21T13:06:41.958 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:41.964 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:42.036 INFO:teuthology.orchestra.run.smithi157.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-21T13:06:42.041 INFO:teuthology.orchestra.run.smithi157.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-21T13:06:42.208 INFO:teuthology.orchestra.run.smithi157.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-21T13:06:42.208 INFO:teuthology.orchestra.run.smithi157.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-21T13:06:42.208 INFO:teuthology.orchestra.run.smithi157.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-21T13:06:42.237 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-03-21T13:06:42.710 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-03-21T13:06:42.736 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-03-21T13:06:42.736 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-03-21T13:06:42.736 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.101.98 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-03-21T13:06:42.737 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-03-21T13:06:42.738 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-101-generic 2024-03-21T13:06:42.738 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-21T13:06:42.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-21T13:06:42.738 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-03-21T13:06:42.738 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-03-21T13:06:42.738 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get clean 2024-03-21T13:06:42.895 DEBUG:teuthology.orchestra.run.smithi157:> sudo apt-get update 2024-03-21T13:06:43.031 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-21T13:06:43.031 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-21T13:06:43.043 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-21T13:06:43.070 INFO:teuthology.orchestra.run.smithi157.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-21T13:06:44.395 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-03-21T13:06:44.411 DEBUG:teuthology.orchestra.run.smithi157:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-21T13:06:44.474 INFO:teuthology.orchestra.run.smithi157.stdout:Reading package lists... 2024-03-21T13:06:44.671 INFO:teuthology.orchestra.run.smithi157.stdout:Building dependency tree... 2024-03-21T13:06:44.672 INFO:teuthology.orchestra.run.smithi157.stdout:Reading state information... 2024-03-21T13:06:44.848 INFO:teuthology.orchestra.run.smithi157.stdout:linux-image-generic is already the newest version (5.15.0.101.98). 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout:The following packages were automatically installed and are no longer required: 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-21T13:06:44.849 INFO:teuthology.orchestra.run.smithi157.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-21T13:06:44.891 INFO:teuthology.orchestra.run.smithi157.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-03-21T13:06:44.893 DEBUG:teuthology.orchestra.run.smithi157:> dpkg -s linux-image-generic 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Package: linux-image-generic 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Status: install ok installed 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Priority: optional 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Section: kernel 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Installed-Size: 21 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Maintainer: Ubuntu Kernel Team 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: amd64 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Source: linux-meta 2024-03-21T13:06:44.909 INFO:teuthology.orchestra.run.smithi157.stdout:Version: 5.15.0.101.98 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-101), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout:Depends: linux-image-5.15.0-101-generic, linux-modules-extra-5.15.0-101-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout:Recommends: thermald 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout:Description: Generic Linux kernel image 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout: This package will always depend on the latest generic kernel image 2024-03-21T13:06:44.910 INFO:teuthology.orchestra.run.smithi157.stdout: available. 2024-03-21T13:06:44.910 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-03-21T13:06:44.956 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.RdVHTDaOxd 2024-03-21T13:06:44.956 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub/grub.cfg /tmp/tmp.RdVHTDaOxd 2024-03-21T13:06:45.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.RdVHTDaOxd 2024-03-21T13:06:45.134 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.RdVHTDaOxd is 10KB 2024-03-21T13:06:45.147 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.RdVHTDaOxd 2024-03-21T13:06:45.153 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-21T13:06:45.207 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:06:45.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-21T13:06:45.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-21T13:06:45.296 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-101-generic 2024-03-21T13:06:45.296 DEBUG:teuthology.orchestra.run.smithi157:> sudo update-grub 2024-03-21T13:06:46.667 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub' 2024-03-21T13:06:46.668 INFO:teuthology.orchestra.run.smithi157.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-21T13:06:46.672 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-03-21T13:06:46.866 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-101-generic 2024-03-21T13:06:46.871 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-101-generic 2024-03-21T13:06:47.146 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-21T13:06:47.152 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-21T13:06:47.199 INFO:teuthology.orchestra.run.smithi157.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-21T13:06:47.205 INFO:teuthology.orchestra.run.smithi157.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-21T13:06:47.329 INFO:teuthology.orchestra.run.smithi157.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-21T13:06:47.329 INFO:teuthology.orchestra.run.smithi157.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-21T13:06:47.329 INFO:teuthology.orchestra.run.smithi157.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-21T13:06:47.349 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-03-21T13:06:47.351 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-03-21T13:07:11.845 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-21T13:07:11.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:07:11.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:07:17.358 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-21T13:07:17.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:07:17.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:07:30.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-21T13:07:35.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-21T13:07:39.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:07:39.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:07:44.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:07:44.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:07:47.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-21T13:07:59.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:07:59.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:08:02.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-21T13:08:17.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:08:17.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:08:36.511 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-21T13:08:39.221 DEBUG:teuthology.orchestra.remote:timed out 2024-03-21T13:08:51.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:08:51.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:08:51.465 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-03-21T13:08:52.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:08:52.038 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-101-generic"... 2024-03-21T13:08:52.039 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-03-21T13:08:52.085 INFO:teuthology.orchestra.run.smithi005.stdout:5.15.0-101-generic 2024-03-21T13:08:52.086 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-21T13:08:52.086 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-21T13:08:52.086 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-21T13:08:53.087 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-21T13:08:53.087 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-21T13:08:53.156 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-03-21T13:08:53.198 DEBUG:teuthology.parallel:result is None 2024-03-21T13:08:54.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:08:54.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:08:54.906 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-03-21T13:08:55.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:08:55.471 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.15.0-101-generic"... 2024-03-21T13:08:55.471 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-03-21T13:08:55.516 INFO:teuthology.orchestra.run.smithi157.stdout:5.15.0-101-generic 2024-03-21T13:08:55.516 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-101-generic vs 5.15.0-101-generic 2024-03-21T13:08:55.516 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-21T13:08:55.516 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-21T13:08:56.517 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-21T13:08:56.517 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-21T13:08:56.891 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-03-21T13:08:56.910 DEBUG:teuthology.parallel:result is None 2024-03-21T13:08:56.911 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-21T13:08:56.920 INFO:teuthology.task.internal:Creating test directory... 2024-03-21T13:08:56.921 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-21T13:08:56.924 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-21T13:08:56.929 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-21T13:08:56.936 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-21T13:08:56.943 INFO:teuthology.task.internal:Creating archive directory... 2024-03-21T13:08:56.944 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-21T13:08:56.971 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-21T13:08:56.990 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-21T13:08:56.998 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-21T13:08:56.999 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-21T13:08:57.027 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-21T13:08:57.048 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T13:08:57.058 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T13:08:57.070 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T13:08:57.079 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-21T13:08:57.080 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-21T13:08:57.087 INFO:teuthology.task.internal:Configuring sudo... 2024-03-21T13:08:57.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-21T13:08:57.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-21T13:08:57.137 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-21T13:08:57.145 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-21T13:08:57.146 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-21T13:08:57.167 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-21T13:08:57.185 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T13:08:57.222 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T13:08:57.270 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:08:57.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-21T13:08:57.347 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-21T13:08:57.353 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-21T13:08:57.400 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:08:57.401 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-21T13:08:57.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-03-21T13:08:57.478 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-03-21T13:08:57.546 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-21T13:08:57.554 INFO:teuthology.task.internal:Starting timer... 2024-03-21T13:08:57.554 INFO:teuthology.run_tasks:Running task pcp... 2024-03-21T13:08:57.564 INFO:teuthology.run_tasks:Running task selinux... 2024-03-21T13:08:57.573 DEBUG:teuthology.task.selinux:Excluding smithi005: OS 'ubuntu' does not support SELinux 2024-03-21T13:08:57.573 DEBUG:teuthology.task.selinux:Excluding smithi157: OS 'ubuntu' does not support SELinux 2024-03-21T13:08:57.573 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-21T13:08:57.573 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-21T13:08:57.573 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-21T13:08:57.573 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-21T13:08:57.584 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-21T13:08:57.605 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-21T13:08:57.607 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-21T13:16:03.919 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-03-21T13:16:03.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:16:03.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:16:04.003 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-03-21T13:16:04.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-21T13:16:04.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:16:04.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:16:04.162 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-03-21T13:16:04.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-21T13:16:04.239 INFO:teuthology.run_tasks:Running task clock... 2024-03-21T13:16:04.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-21T13:16:04.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-21T13:16:04.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T13:16:04.257 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-21T13:16:04.257 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T13:16:04.286 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-21T13:16:04.286 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Command line: ntpd -gq 2024-03-21T13:16:04.286 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: ---------------------------------------------------- 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: ntp-4 is maintained by Network Time Foundation, 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: corporation. Support and training for ntp-4 are 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: available at https://www.nwtime.org/support 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: ---------------------------------------------------- 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: proto: precision = 0.045 usec (-24) 2024-03-21T13:16:04.287 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: basedate set to 2022-02-04 2024-03-21T13:16:04.288 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: gps base set to 2022-02-06 (week 2196) 2024-03-21T13:16:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-21T13:16:04.288 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-21T13:16:04.288 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: restrict ::: KOD does nothing without LIMITED. 2024-03-21T13:16:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-21T13:16:04.289 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen and drop on 0 v6wildcard [::]:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen normally on 2 lo 127.0.0.1:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen normally on 3 ens1f0 172.21.15.5:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen normally on 4 lo [::1]:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1442%4]:123 2024-03-21T13:16:04.290 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:04 ntpd[17117]: Listening on routing socket on fd #22 for interface updates 2024-03-21T13:16:04.309 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-21T13:16:04.309 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Command line: ntpd -gq 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: ---------------------------------------------------- 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: ntp-4 is maintained by Network Time Foundation, 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: corporation. Support and training for ntp-4 are 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: available at https://www.nwtime.org/support 2024-03-21T13:16:04.310 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: ---------------------------------------------------- 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: proto: precision = 0.061 usec (-24) 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: basedate set to 2022-02-04 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: gps base set to 2022-02-06 (week 2196) 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-21T13:16:04.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: restrict ::: KOD does nothing without LIMITED. 2024-03-21T13:16:04.312 INFO:teuthology.orchestra.run.smithi157.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen and drop on 0 v6wildcard [::]:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen normally on 2 lo 127.0.0.1:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen normally on 3 enp3s0f1 172.21.15.157:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen normally on 4 lo [::1]:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ea1%5]:123 2024-03-21T13:16:04.313 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:04 ntpd[17189]: Listening on routing socket on fd #22 for interface updates 2024-03-21T13:16:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:05.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:05.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:05 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:05.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:05.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:05.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:05.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:05.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:05.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:05 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:06 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:06.287 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:06 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:06.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:06 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:06.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:06 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:07.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:07 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:07.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:07 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:08.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:08.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:08.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:08.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:08.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:08.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:08 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:09.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.290 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:09.290 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:09 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:09.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:09.312 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:09 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:10.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:10.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:10 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.288 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:11.289 INFO:teuthology.orchestra.run.smithi005.stdout:21 Mar 13:16:11 ntpd[17117]: ntpd: time slew -0.002530 s 2024-03-21T13:16:11.290 INFO:teuthology.orchestra.run.smithi005.stdout:ntpd: time slew -0.002530s 2024-03-21T13:16:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-21T13:16:11.290 INFO:teuthology.orchestra.run.smithi005.stderr:21 Mar 13:16:11 ntpd[17117]: can't open /var/log/ntpstats/loopstats.20240321: Permission denied 2024-03-21T13:16:11.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.310 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: can't open /var/log/ntpstats/rawstats.20240321: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: can't open /var/log/ntpstats/peerstats.20240321: Permission denied 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stdout:21 Mar 13:16:11 ntpd[17189]: ntpd: time slew +0.001660 s 2024-03-21T13:16:11.311 INFO:teuthology.orchestra.run.smithi157.stdout:ntpd: time slew +0.001660s 2024-03-21T13:16:11.312 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-21T13:16:11.312 INFO:teuthology.orchestra.run.smithi157.stderr:21 Mar 13:16:11 ntpd[17189]: can't open /var/log/ntpstats/loopstats.20240321: Permission denied 2024-03-21T13:16:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-03-21T13:16:11.341 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-03-21T13:16:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.361 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-21T13:16:11.362 INFO:teuthology.run_tasks:Running task nvme_loop... 2024-03-21T13:16:11.374 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2024-03-21T13:16:11.375 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:16:11.375 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:16:11.390 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-21T13:16:11.391 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-03-21T13:16:11.438 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:12:46.923882844 +0000 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:12:46.663885167 +0000 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:12:46.663885167 +0000 2024-03-21T13:16:11.439 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:16:11.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-21T13:16:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:16:11.493 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:16:11.494 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000313237 s, 1.6 MB/s 2024-03-21T13:16:11.495 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-21T13:16:11.545 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:12:47.443878198 +0000 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:12:47.155880772 +0000 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:12:47.155880772 +0000 2024-03-21T13:16:11.591 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:16:11.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-21T13:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:16:11.645 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00019949 s, 2.6 MB/s 2024-03-21T13:16:11.646 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-21T13:16:11.696 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:12:47.691875983 +0000 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:12:47.687876020 +0000 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:12:47.687876020 +0000 2024-03-21T13:16:11.743 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:16:11.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-21T13:16:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:16:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:16:11.797 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000300464 s, 1.7 MB/s 2024-03-21T13:16:11.798 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-21T13:16:11.848 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:12:48.399869661 +0000 2024-03-21T13:16:11.895 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:12:48.159871803 +0000 2024-03-21T13:16:11.896 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:12:48.159871803 +0000 2024-03-21T13:16:11.896 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:16:11.896 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-21T13:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000193236 s, 2.6 MB/s 2024-03-21T13:16:11.950 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-21T13:16:12.001 DEBUG:teuthology.orchestra.run.smithi005:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-03-21T13:16:12.146 INFO:teuthology.orchestra.run.smithi005.stdout:loop 2024-03-21T13:16:12.147 INFO:tasks.nvme_loop:Connecting nvme_loop smithi005:/dev/vg_nvme/lv_1... 2024-03-21T13:16:12.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-03-21T13:16:12.166 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-03-21T13:16:12.188 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/vg_nvme/lv_11 2024-03-21T13:16:12.206 INFO:tasks.nvme_loop:Connecting nvme_loop smithi005:/dev/vg_nvme/lv_2... 2024-03-21T13:16:12.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-03-21T13:16:12.268 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-03-21T13:16:12.289 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/vg_nvme/lv_21 2024-03-21T13:16:12.308 INFO:tasks.nvme_loop:Connecting nvme_loop smithi005:/dev/vg_nvme/lv_3... 2024-03-21T13:16:12.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-03-21T13:16:12.367 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-03-21T13:16:12.389 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/vg_nvme/lv_31 2024-03-21T13:16:12.406 INFO:tasks.nvme_loop:Connecting nvme_loop smithi005:/dev/vg_nvme/lv_4... 2024-03-21T13:16:12.406 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-03-21T13:16:12.466 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-03-21T13:16:12.488 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/vg_nvme/lv_41 2024-03-21T13:16:12.506 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:16:12.506 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:16:12.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo nvme list 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:Node SN Model Namespace Usage Format FW Rev 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/nvme0n1 PHMB751300EW480DGN INTEL SSDPED1D480GA 1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/nvme1n1 209da5b01820384eaa4b Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/nvme2n1 de9c816c5708b23f394f Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/nvme3n1 3f79570def0c73e10b18 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:12.614 INFO:teuthology.orchestra.run.smithi005.stdout:/dev/nvme4n1 c04c3b73d59dae425dc2 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:12.615 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-03-21T13:16:12.615 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:16:12.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/scratch_devs 2024-03-21T13:16:12.671 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:16:12.671 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:16:12.677 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-21T13:16:12.677 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:12:44.084491718 +0000 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:12:43.820494076 +0000 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:12:43.820494076 +0000 2024-03-21T13:16:12.723 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:16:12.724 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-21T13:16:12.777 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:16:12.777 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:16:12.777 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000313421 s, 1.6 MB/s 2024-03-21T13:16:12.778 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-21T13:16:12.828 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:12:44.536487681 +0000 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:12:44.304489753 +0000 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:12:44.304489753 +0000 2024-03-21T13:16:12.875 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:16:12.876 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-21T13:16:12.928 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:16:12.928 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:16:12.928 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000202676 s, 2.5 MB/s 2024-03-21T13:16:12.930 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-21T13:16:12.981 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-03-21T13:16:13.030 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-21T13:16:13.030 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:13.030 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-03-21T13:16:13.031 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:13.031 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:12:45.012483428 +0000 2024-03-21T13:16:13.031 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:12:44.772485573 +0000 2024-03-21T13:16:13.031 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:12:44.772485573 +0000 2024-03-21T13:16:13.031 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:16:13.031 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-21T13:16:13.084 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:16:13.084 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:16:13.084 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000241622 s, 2.1 MB/s 2024-03-21T13:16:13.086 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-21T13:16:13.135 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-03-21T13:16:13.182 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-21T13:16:13.182 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-21T13:16:13.182 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-03-21T13:16:13.182 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-21T13:16:13.183 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:12:45.252481286 +0000 2024-03-21T13:16:13.183 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:12:45.248481320 +0000 2024-03-21T13:16:13.183 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:12:45.248481320 +0000 2024-03-21T13:16:13.183 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:16:13.183 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-21T13:16:13.236 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:16:13.236 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:16:13.236 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00023778 s, 2.2 MB/s 2024-03-21T13:16:13.237 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-21T13:16:13.287 DEBUG:teuthology.orchestra.run.smithi157:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-03-21T13:16:13.434 INFO:teuthology.orchestra.run.smithi157.stdout:loop 2024-03-21T13:16:13.435 INFO:tasks.nvme_loop:Connecting nvme_loop smithi157:/dev/vg_nvme/lv_1... 2024-03-21T13:16:13.435 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-03-21T13:16:13.452 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-03-21T13:16:13.473 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/vg_nvme/lv_11 2024-03-21T13:16:13.489 INFO:tasks.nvme_loop:Connecting nvme_loop smithi157:/dev/vg_nvme/lv_2... 2024-03-21T13:16:13.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-03-21T13:16:13.549 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-03-21T13:16:13.570 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/vg_nvme/lv_21 2024-03-21T13:16:13.587 INFO:tasks.nvme_loop:Connecting nvme_loop smithi157:/dev/vg_nvme/lv_3... 2024-03-21T13:16:13.587 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-03-21T13:16:13.647 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-03-21T13:16:13.668 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/vg_nvme/lv_31 2024-03-21T13:16:13.684 INFO:tasks.nvme_loop:Connecting nvme_loop smithi157:/dev/vg_nvme/lv_4... 2024-03-21T13:16:13.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-03-21T13:16:13.742 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-03-21T13:16:13.761 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/vg_nvme/lv_41 2024-03-21T13:16:13.781 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:16:13.781 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:16:13.830 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme list 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:Node SN Model Namespace Usage Format FW Rev 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme1n1 8047e1eac342e4fcc295 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n1 682bf8a0c98a24cf6871 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:13.885 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme3n1 bad7debd1d6537532b71 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:13.886 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme4n1 440ba9a2ca3e9575c994 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-03-21T13:16:13.886 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-03-21T13:16:13.887 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:16:13.887 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/scratch_devs 2024-03-21T13:16:13.941 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-21T13:16:14.041 INFO:tasks.cephadm:Config: {'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '960fbbe4645c2becc8084669be194c95183c7753'} 2024-03-21T13:16:14.041 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:16:14.042 INFO:tasks.cephadm:Cluster fsid is 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:16:14.042 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-21T13:16:14.042 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-03-21T13:16:14.042 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi005': '172.21.15.5', 'mon.smithi157': '172.21.15.157'} 2024-03-21T13:16:14.042 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-21T13:16:14.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-03-21T13:16:14.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-03-21T13:16:14.073 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-21T13:16:14.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:16:14.306 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '960fbbe4645c2becc8084669be194c95183c7753', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/77830/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2267-g960fbbe4', 'node_name': '172.21.2.11+braggi11', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2267-g960fbbe4-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-guits-testing-2024-03-21-0818/960fbbe4645c2becc8084669be194c95183c7753/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-03-21 11:37:05.059114', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-testing-2024-03-21-0818', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-guits-testing-2024-03-21-0818/960fbbe4645c2becc8084669be194c95183c7753/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-03-21T13:16:14.519 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-guits-testing-2024-03-21-0818, sha1 960fbbe4645c2becc8084669be194c95183c7753 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:16:14.521 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-2024-03-21-0818/960fbbe4645c2becc8084669be194c95183c7753/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-03-21T13:16:14.521 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-2024-03-21-0818/960fbbe4645c2becc8084669be194c95183c7753/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:15.714 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-rw-r-- 1 ubuntu ubuntu 776456 Mar 21 13:16 /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:15.714 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-2024-03-21-0818/960fbbe4645c2becc8084669be194c95183c7753/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:17.103 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-rw-r-- 1 ubuntu ubuntu 776456 Mar 21 13:16 /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:17.103 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:17.111 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-21T13:16:17.126 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 on all hosts... 2024-03-21T13:16:17.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 pull 2024-03-21T13:16:17.154 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 pull 2024-03-21T13:16:17.322 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753... 2024-03-21T13:16:17.323 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753... 2024-03-21T13:17:35.149 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-03-21T13:17:35.149 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev)", 2024-03-21T13:17:35.149 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "19e12293512ff7978c8adb5f72a829060dd47f07bfd6903b6b3178d2ebc29e4e", 2024-03-21T13:17:35.149 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-03-21T13:17:35.150 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:35f4b82cbae750007a45d4eba3ff9f653c457c283782141ef353684823d81e93" 2024-03-21T13:17:35.150 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-03-21T13:17:35.150 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-03-21T13:17:36.469 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-03-21T13:17:36.469 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev)", 2024-03-21T13:17:36.469 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "19e12293512ff7978c8adb5f72a829060dd47f07bfd6903b6b3178d2ebc29e4e", 2024-03-21T13:17:36.470 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-03-21T13:17:36.470 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:35f4b82cbae750007a45d4eba3ff9f653c457c283782141ef353684823d81e93" 2024-03-21T13:17:36.470 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-03-21T13:17:36.470 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-03-21T13:17:36.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-03-21T13:17:36.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-03-21T13:17:36.547 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-03-21T13:17:36.592 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-03-21T13:17:36.604 INFO:tasks.cephadm:Writing seed config... 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-21T13:17:36.605 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-21T13:17:36.606 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:17:36.606 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-21T13:17:36.640 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3164d712-e785-11ee-95cd-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-21T13:17:36.640 DEBUG:teuthology.orchestra.run.smithi005:mon.smithi005> sudo journalctl -f -n 0 -u ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service 2024-03-21T13:17:36.685 INFO:tasks.cephadm:Bootstrapping... 2024-03-21T13:17:36.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 -v bootstrap --fsid 3164d712-e785-11ee-95cd-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:17:36.896 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-03-21T13:17:36.897 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753', '-v', 'bootstrap', '--fsid', '3164d712-e785-11ee-95cd-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-03-21T13:17:36.897 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-21T13:17:36.897 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-03-21T13:17:36.897 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-03-21T13:17:36.897 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-03-21T13:17:36.904 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-21T13:17:36.904 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-21T13:17:36.908 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-21T13:17:36.909 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.913 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-21T13:17:36.913 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-21T13:17:36.917 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-21T13:17:36.917 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.921 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-21T13:17:36.921 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout masked 2024-03-21T13:17:36.925 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-21T13:17:36.925 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.929 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-21T13:17:36.929 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-21T13:17:36.933 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-21T13:17:36.933 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.937 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:Unit ntp.service is enabled and running 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:docker (/usr/bin/docker) is present 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-03-21T13:17:36.943 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-03-21T13:17:36.948 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-21T13:17:36.948 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-21T13:17:36.952 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-21T13:17:36.952 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.957 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-03-21T13:17:36.957 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-03-21T13:17:36.961 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-03-21T13:17:36.961 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.965 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-03-21T13:17:36.965 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout masked 2024-03-21T13:17:36.969 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-03-21T13:17:36.969 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.973 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-03-21T13:17:36.973 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-03-21T13:17:36.976 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-03-21T13:17:36.977 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-03-21T13:17:36.980 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Unit ntp.service is enabled and running 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 139949575011632 on /run/cephadm/3164d712-e785-11ee-95cd-87774f69a715.lock 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 139949575011632 acquired on /run/cephadm/3164d712-e785-11ee-95cd-87774f69a715.lock 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-03-21T13:17:36.985 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-03-21T13:17:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-03-21T13:17:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-03-21T13:17:36.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 2024-03-21T13:17:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-21T13:17:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-03-21T13:17:36.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-03-21T13:17:36.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-21T13:17:36.993 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-03-21T13:17:36.993 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-03-21T13:17:36.993 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-21T13:17:36.993 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-21T13:17:36.994 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753... 2024-03-21T13:17:37.280 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/docker: stdout 960fbbe4645c2becc8084669be194c95183c7753: Pulling from ceph-ci/ceph 2024-03-21T13:17:37.280 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/docker: stdout Digest: sha256:35f4b82cbae750007a45d4eba3ff9f653c457c283782141ef353684823d81e93 2024-03-21T13:17:37.280 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:17:37.280 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 2024-03-21T13:17:38.640 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev) 2024-03-21T13:17:38.641 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev) 2024-03-21T13:17:38.641 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-03-21T13:17:39.802 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-03-21T13:17:39.802 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-03-21T13:17:40.915 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQB0M/xlNe7OHBAAjlsIl2tiiurhEX/0UljmZw== 2024-03-21T13:17:42.105 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQB1M/xlKR5IIhAAz8TtSLdHgqZcB91c79FPbw== 2024-03-21T13:17:43.283 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQB2M/xl067SKxAAAPGe7vsJ6h9wEz2EgGUyvw== 2024-03-21T13:17:43.285 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-03-21T13:17:44.464 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-21T13:17:44.464 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for smithi005 [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:17:44.465 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.192+0000 7f0de3083c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.192+0000 7f0de3083c80 1 imported monmap: 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr fsid 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-03-21T13:17:43.965836+0000 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr created 2024-03-21T13:17:43.965836+0000 2024-03-21T13:17:45.724 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.smithi005 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.192+0000 7f0de3083c80 0 /usr/bin/ceph-mon: set fsid to 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: RocksDB version: 7.9.2 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Git sha 0 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Compile date 2024-03-21 08:53:26 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: DB SUMMARY 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: DB Session ID: AIJFZSBT184Q9S76GUS4 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi005/store.db dir, Total Num: 0, files: 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi005/store.db: 2024-03-21T13:17:45.725 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.error_if_exists: 0 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.create_if_missing: 1 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.paranoid_checks: 1 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.env: 0x557ab8259b20 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.info_log: 0x557ab981ca80 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.statistics: (nil) 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.use_fsync: 0 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_log_file_size: 0 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-21T13:17:45.726 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_fallocate: 1 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.use_direct_reads: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.db_log_dir: 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.wal_dir: 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-21T13:17:45.727 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.write_buffer_manager: 0x557ab97ef360 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-21T13:17:45.728 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.unordered_write: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.row_cache: None 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.wal_filter: None 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.two_write_queues: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.wal_compression: 0 2024-03-21T13:17:45.729 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.atomic_flush: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.log_readahead_size: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_background_jobs: 2 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_background_compactions: -1 2024-03-21T13:17:45.730 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_subcompactions: 1 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_open_files: -1 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_background_flushes: -1 2024-03-21T13:17:45.731 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Compression algorithms supported: 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kZSTD supported: 0 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kXpressCompression supported: 0 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kZlibCompression supported: 1 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kSnappyCompression supported: 1 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kLZ4Compression supported: 1 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: kBZip2Compression supported: 0 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-03-21T13:17:45.732 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000001 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.merge_operator: 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_filter: None 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557ab981cb80) 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-03-21T13:17:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x557ab9821090 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-03-21T13:17:45.734 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-03-21T13:17:45.735 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression: NoCompression 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.num_levels: 7 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-21T13:17:45.736 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-21T13:17:45.737 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-21T13:17:45.738 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-21T13:17:45.739 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-21T13:17:45.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.table_properties_collectors: 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.inplace_update_support: 0 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-21T13:17:45.741 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.bloom_locality: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.max_successive_merges: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.ttl: 2592000 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enable_blob_files: false 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.min_blob_size: 0 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-21T13:17:45.742 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c5bd7364-6b7c-43e2-999d-03dd75145744 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.196+0000 7f0de3083c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0de3083c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557ab98ea000 2024-03-21T13:17:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0de3083c80 4 rocksdb: DB pointer 0x557ab98da000 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0dd31e7700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0dd31e7700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-03-21T13:17:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x557ab9821090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0de3083c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0de3083c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-mon: stderr debug 2024-03-21T13:17:45.200+0000 7f0de3083c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi005 for mon.smithi005 2024-03-21T13:17:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.smithi005 on 2024-03-21T13:17:46.181 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-03-21T13:17:46.415 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3164d712-e785-11ee-95cd-87774f69a715.target -> /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715.target. 2024-03-21T13:17:46.415 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3164d712-e785-11ee-95cd-87774f69a715.target -> /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715.target. 2024-03-21T13:17:46.707 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005 2024-03-21T13:17:46.708 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service: Unit ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service not loaded. 2024-03-21T13:17:46.901 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715.target.wants/ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service -> /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service. 2024-03-21T13:17:46.910 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld does not appear to be present 2024-03-21T13:17:46.910 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-03-21T13:17:46.910 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-03-21T13:17:46.910 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-03-21T13:17:48.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:48 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.176625+0000 mon.smithi005 (mon.0) 1 : cluster [INF] mon.smithi005 is new leader, mons smithi005 in quorum (ranks 0) 2024-03-21T13:17:48.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-03-21T13:17:48.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:48.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi005 (age 0.147752s) 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-03-21T13:17:48.839 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.179818+0000 mon.smithi005 (mon.0) 2 : cluster [INF] mon.smithi005 is new leader, mons smithi005 in quorum (ranks 0) 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.179945+0000 mon.smithi005 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.181751+0000 mon.smithi005 (mon.0) 4 : cluster [DBG] fsmap 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.183769+0000 mon.smithi005 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: cluster 2024-03-21T13:17:48.184164+0000 mon.smithi005 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-03-21T13:17:49.444 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:49 smithi005 bash[18126]: audit 2024-03-21T13:17:48.327530+0000 mon.smithi005 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.5:0/1199444908' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-21T13:17:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-03-21T13:17:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-03-21T13:17:50.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-21T13:17:50.320 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-03-21T13:17:50.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:50 smithi005 bash[18126]: audit 2024-03-21T13:17:49.755912+0000 mon.smithi005 (mon.0) 8 : audit [INF] from='client.? 172.21.15.5:0/3847620511' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-21T13:17:50.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:50 smithi005 bash[18126]: audit 2024-03-21T13:17:49.760168+0000 mon.smithi005 (mon.0) 9 : audit [INF] from='client.? 172.21.15.5:0/3847620511' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-21T13:17:51.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:51 smithi005 bash[18126]: audit 2024-03-21T13:17:51.363471+0000 mon.smithi005 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.5:0/3073620688' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:17:51.905 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-03-21T13:17:52.213 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:51 smithi005 systemd[1]: Stopping Ceph mon.smithi005 for 3164d712-e785-11ee-95cd-87774f69a715... 2024-03-21T13:17:52.213 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 bash[18126]: debug 2024-03-21T13:17:52.024+0000 7f91773e3700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi005 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-21T13:17:52.213 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 bash[18126]: debug 2024-03-21T13:17:52.024+0000 7f91773e3700 -1 mon.smithi005@0(leader) e1 *** Got Signal Terminated *** 2024-03-21T13:17:52.759 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-21T13:17:53.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 bash[18514]: ceph-3164d712-e785-11ee-95cd-87774f69a715-mon-smithi005 2024-03-21T13:17:53.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 bash[18576]: ceph-3164d712-e785-11ee-95cd-87774f69a715-mon-smithi005 2024-03-21T13:17:53.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 systemd[1]: ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service: Deactivated successfully. 2024-03-21T13:17:53.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 systemd[1]: Stopped Ceph mon.smithi005 for 3164d712-e785-11ee-95cd-87774f69a715. 2024-03-21T13:17:53.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:52 smithi005 systemd[1]: Started Ceph mon.smithi005 for 3164d712-e785-11ee-95cd-87774f69a715. 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.772+0000 7f01120eec80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.772+0000 7f01120eec80 0 ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev), process ceph-mon, pid 7 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.772+0000 7f01120eec80 0 pidfile_write: ignore empty --pid-file 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 0 load: jerasure load: lrc 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: RocksDB version: 7.9.2 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Git sha 0 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Compile date 2024-03-21 08:53:26 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: DB SUMMARY 2024-03-21T13:17:54.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: DB Session ID: JJK37NYKIQKXANGVQDRO 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: CURRENT file: CURRENT 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi005/store.db dir, Total Num: 1, files: 000008.sst 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi005/store.db: 000009.log size: 85003 ; 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.error_if_exists: 0 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.create_if_missing: 0 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.paranoid_checks: 1 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.env: 0x558d790b8b20 2024-03-21T13:17:54.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.info_log: 0x558d7b85d800 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.statistics: (nil) 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.use_fsync: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_log_file_size: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_fallocate: 1 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.use_direct_reads: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-21T13:17:54.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.db_log_dir: 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.wal_dir: 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.write_buffer_manager: 0x558d7b82e1e0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-21T13:17:54.009 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.unordered_write: 0 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.row_cache: None 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.wal_filter: None 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-21T13:17:54.010 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.two_write_queues: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.wal_compression: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.atomic_flush: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.log_readahead_size: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-21T13:17:54.011 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_background_jobs: 2 2024-03-21T13:17:54.012 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_background_compactions: -1 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_subcompactions: 1 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_open_files: -1 2024-03-21T13:17:54.013 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Options.max_background_flushes: -1 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Compression algorithms supported: 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kZSTD supported: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kXpressCompression supported: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kZlibCompression supported: 1 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kSnappyCompression supported: 1 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kLZ4Compression supported: 1 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: kBZip2Compression supported: 0 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-21T13:17:54.014 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.776+0000 7f01120eec80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000010 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.merge_operator: 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_filter: None 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558d7b85d920) 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cache_index_and_filter_blocks: 1 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: pin_top_level_index_and_filter: 1 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: index_type: 0 2024-03-21T13:17:54.015 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: data_block_index_type: 0 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: index_shortening: 1 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: data_block_hash_table_util_ratio: 0.750000 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: checksum: 4 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: no_block_cache: 0 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_cache: 0x558d7b85f090 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_cache_name: BinnedLRUCache 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_cache_options: 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: capacity : 536870912 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: num_shard_bits : 4 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: strict_capacity_limit : 0 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: high_pri_pool_ratio: 0.000 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_cache_compressed: (nil) 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: persistent_cache: (nil) 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_size: 4096 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_size_deviation: 10 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_restart_interval: 16 2024-03-21T13:17:54.016 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: index_block_restart_interval: 1 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: metadata_block_size: 4096 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: partition_filters: 0 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: use_delta_encoding: 1 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: filter_policy: bloomfilter 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: whole_key_filtering: 1 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: verify_compression: 0 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: read_amp_bytes_per_bit: 0 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: format_version: 5 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: enable_index_compression: 1 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: block_align: 0 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: max_auto_readahead_size: 262144 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: prepopulate_block_cache: 0 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: initial_auto_readahead_size: 8192 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: num_file_reads_for_auto_readahead: 2 2024-03-21T13:17:54.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression: NoCompression 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.num_levels: 7 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:17:54.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-21T13:17:54.019 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-21T13:17:54.020 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.table_properties_collectors: 2024-03-21T13:17:54.021 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.inplace_update_support: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.bloom_locality: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.max_successive_merges: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.ttl: 2592000 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-21T13:17:54.022 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.enable_blob_files: false 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.min_blob_size: 0 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c5bd7364-6b7c-43e2-999d-03dd75145744 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027073784763, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-21T13:17:54.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027073785742, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81737, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 250, "table_properties": {"data_size": 79924, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 9884, "raw_average_key_size": 47, "raw_value_size": 74257, "raw_average_value_size": 355, "num_data_blocks": 10, "num_entries": 209, "num_filter_entries": 209, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711027073, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c5bd7364-6b7c-43e2-999d-03dd75145744", "db_session_id": "JJK37NYKIQKXANGVQDRO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027073785832, "job": 1, "event": "recovery_finished"} 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi005/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558d7b950000 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f01120eec80 4 rocksdb: DB pointer 0x558d7b93c000 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f010084a700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.780+0000 7f010084a700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: ** DB Stats ** 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-21T13:17:54.024 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: ** Compaction Stats [default] ** 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: L0 2/0 81.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Sum 2/0 81.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: ** Compaction Stats [default] ** 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-21T13:17:54.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: AddFile(Total Files): cumulative 0, interval 0 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: AddFile(Keys): cumulative 0, interval 0 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Cumulative compaction: 0.00 GB write, 21.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Interval compaction: 0.00 GB write, 21.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Block cache BinnedLRUCache@0x558d7b85f090#7 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: ** File Read Latency Histogram By Level [default] ** 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 starting mon.smithi005 rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi005 fsid 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 1 mon.smithi005@-1(???) e1 preinit fsid 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).mds e1 new map 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).mds e1 print_map 2024-03-21T13:17:54.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: e1 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: legacy client fscid: -1 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: No filesystems configured 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 0 mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: debug 2024-03-21T13:17:53.784+0000 7f01120eec80 1 mon.smithi005@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cluster 2024-03-21T13:17:53.812203+0000 mon.smithi005 (mon.0) 1 : cluster [INF] mon.smithi005 is new leader, mons smithi005 in quorum (ranks 0) 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cluster 2024-03-21T13:17:53.812292+0000 mon.smithi005 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cluster 2024-03-21T13:17:53.812708+0000 mon.smithi005 (mon.0) 3 : cluster [DBG] fsmap 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cluster 2024-03-21T13:17:53.812747+0000 mon.smithi005 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-03-21T13:17:54.027 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:53 smithi005 bash[18615]: cluster 2024-03-21T13:17:53.813101+0000 mon.smithi005 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-03-21T13:17:54.557 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-21T13:17:54.600 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:17:54.600 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-03-21T13:17:54.601 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-21T13:17:54.601 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-21T13:17:54.601 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8443 ... 2024-03-21T13:17:54.930 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3164d712-e785-11ee-95cd-87774f69a715@mgr.smithi005.rupoiq 2024-03-21T13:17:54.931 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3164d712-e785-11ee-95cd-87774f69a715@mgr.smithi005.rupoiq.service: Unit ceph-3164d712-e785-11ee-95cd-87774f69a715@mgr.smithi005.rupoiq.service not loaded. 2024-03-21T13:17:54.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:54 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:17:55.132 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715.target.wants/ceph-3164d712-e785-11ee-95cd-87774f69a715@mgr.smithi005.rupoiq.service -> /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service. 2024-03-21T13:17:55.140 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld does not appear to be present 2024-03-21T13:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-03-21T13:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld does not appear to be present 2024-03-21T13:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-03-21T13:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-03-21T13:17:55.141 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-03-21T13:17:55.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:54 smithi005 bash[18615]: audit 2024-03-21T13:17:53.990764+0000 mon.smithi005 (mon.0) 6 : audit [INF] from='client.? 172.21.15.5:0/4244012304' entity='client.admin' 2024-03-21T13:17:55.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:55 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:17:56.904 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:17:56 smithi005 bash[18615]: audit 2024-03-21T13:17:56.700263+0000 mon.smithi005 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.5:0/3468151866' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-21T13:17:57.268 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "3164d712-e785-11ee-95cd-87774f69a715", 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-03-21T13:17:57.269 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-21T13:17:57.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-21T13:17:57.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:17:57.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-03-21T13:17:48.180946+0000", 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:17:57.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-21T13:17:57.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:17:57.276 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-03-21T13:18:00.470 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:00 smithi005 bash[18615]: audit 2024-03-21T13:18:00.270832+0000 mon.smithi005 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.5:0/728107018' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "3164d712-e785-11ee-95cd-87774f69a715", 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:00.833 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-21T13:18:00.834 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-21T13:18:00.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-21T13:18:00.835 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-21T13:18:00.838 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-03-21T13:18:00.839 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-03-21T13:17:48.180946+0000", 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:18:00.840 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2024-03-21T13:18:04.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:03 smithi005 bash[18615]: audit 2024-03-21T13:18:03.756747+0000 mon.smithi005 (mon.0) 9 : audit [DBG] from='client.? 172.21.15.5:0/3982351617' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "3164d712-e785-11ee-95cd-87774f69a715", 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-21T13:18:04.304 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-21T13:18:04.305 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-21T13:18:04.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-21T13:18:04.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-21T13:18:04.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-21T13:18:04.306 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-21T13:18:04.309 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-21T13:18:04.310 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-03-21T13:17:48.180946+0000", 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:18:04.311 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (3/15)... 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: cluster 2024-03-21T13:18:04.694297+0000 mon.smithi005 (mon.0) 10 : cluster [INF] Activating manager daemon smithi005.rupoiq 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: cluster 2024-03-21T13:18:04.698265+0000 mon.smithi005 (mon.0) 11 : cluster [DBG] mgrmap e2: smithi005.rupoiq(active, starting, since 0.00430604s) 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.701856+0000 mon.smithi005 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.702048+0000 mon.smithi005 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.702244+0000 mon.smithi005 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.702457+0000 mon.smithi005 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.702651+0000 mon.smithi005 (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-21T13:18:05.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.702865+0000 mon.smithi005 (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.703050+0000 mon.smithi005 (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.703819+0000 mon.smithi005 (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi005.rupoiq", "id": "smithi005.rupoiq"}]: dispatch 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: cluster 2024-03-21T13:18:04.729984+0000 mon.smithi005 (mon.0) 20 : cluster [INF] Manager daemon smithi005.rupoiq is now available 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.742857+0000 mon.smithi005 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/mirror_snapshot_schedule"}]: dispatch 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.745920+0000 mon.smithi005 (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/trash_purge_schedule"}]: dispatch 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.749241+0000 mon.smithi005 (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.751780+0000 mon.smithi005 (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:05.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:04 smithi005 bash[18615]: audit 2024-03-21T13:18:04.753840+0000 mon.smithi005 (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.5:0/1130212102' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:06.957 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:06 smithi005 bash[18615]: cluster 2024-03-21T13:18:05.709041+0000 mon.smithi005 (mon.0) 26 : cluster [DBG] mgrmap e3: smithi005.rupoiq(active, since 1.01507s) 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "3164d712-e785-11ee-95cd-87774f69a715", 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:08.297 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-21T13:18:08.298 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-21T13:18:08.299 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-21T13:18:08.300 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-03-21T13:17:48.180946+0000", 2024-03-21T13:18:08.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-21T13:18:08.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-03-21T13:18:08.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-21T13:18:08.301 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:18:08.301 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-03-21T13:18:09.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:08 smithi005 bash[18615]: cluster 2024-03-21T13:18:07.708198+0000 mon.smithi005 (mon.0) 27 : cluster [DBG] mgrmap e4: smithi005.rupoiq(active, since 3s) 2024-03-21T13:18:09.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:08 smithi005 bash[18615]: audit 2024-03-21T13:18:07.708514+0000 mon.smithi005 (mon.0) 28 : audit [DBG] from='client.? 172.21.15.5:0/3109203930' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-21T13:18:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:09 smithi005 bash[18615]: audit 2024-03-21T13:18:09.489963+0000 mon.smithi005 (mon.0) 29 : audit [INF] from='client.? 172.21.15.5:0/2075936396' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-21T13:18:10.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-21T13:18:10.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-03-21T13:18:10.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-03-21T13:18:10.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-21T13:18:10.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-21T13:18:10.033 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-03-21T13:18:11.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:11 smithi005 bash[18615]: audit 2024-03-21T13:18:11.353620+0000 mon.smithi005 (mon.0) 30 : audit [INF] from='client.? 172.21.15.5:0/1565958078' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-21T13:18:12.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:12 smithi005 bash[18615]: audit 2024-03-21T13:18:11.405433+0000 mon.smithi005 (mon.0) 31 : audit [INF] from='client.? 172.21.15.5:0/1565958078' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-21T13:18:12.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:12 smithi005 bash[18615]: cluster 2024-03-21T13:18:11.410820+0000 mon.smithi005 (mon.0) 32 : cluster [DBG] mgrmap e5: smithi005.rupoiq(active, since 6s) 2024-03-21T13:18:13.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:13 smithi005 bash[18615]: audit 2024-03-21T13:18:13.174007+0000 mon.smithi005 (mon.0) 33 : audit [DBG] from='client.? 172.21.15.5:0/34228194' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-21T13:18:13.793 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:18:13.793 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-21T13:18:13.793 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-21T13:18:13.793 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "smithi005.rupoiq", 2024-03-21T13:18:13.794 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-21T13:18:13.794 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:18:13.794 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-03-21T13:18:13.794 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-03-21T13:18:20.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: cluster 2024-03-21T13:18:19.766197+0000 mon.smithi005 (mon.0) 34 : cluster [INF] Active manager daemon smithi005.rupoiq restarted 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: cluster 2024-03-21T13:18:19.767064+0000 mon.smithi005 (mon.0) 35 : cluster [INF] Activating manager daemon smithi005.rupoiq 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: cluster 2024-03-21T13:18:19.775476+0000 mon.smithi005 (mon.0) 36 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: cluster 2024-03-21T13:18:19.775827+0000 mon.smithi005 (mon.0) 37 : cluster [DBG] mgrmap e6: smithi005.rupoiq(active, starting, since 0.00911386s) 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: audit 2024-03-21T13:18:19.778479+0000 mon.smithi005 (mon.0) 38 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: audit 2024-03-21T13:18:19.780102+0000 mon.smithi005 (mon.0) 39 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi005.rupoiq", "id": "smithi005.rupoiq"}]: dispatch 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: audit 2024-03-21T13:18:19.781400+0000 mon.smithi005 (mon.0) 40 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: audit 2024-03-21T13:18:19.781763+0000 mon.smithi005 (mon.0) 41 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: audit 2024-03-21T13:18:19.781976+0000 mon.smithi005 (mon.0) 42 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-21T13:18:20.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:19 smithi005 bash[18615]: cluster 2024-03-21T13:18:19.805768+0000 mon.smithi005 (mon.0) 43 : cluster [INF] Manager daemon smithi005.rupoiq is now available 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: cephadm 2024-03-21T13:18:19.826959+0000 mgr.smithi005.rupoiq (mgr.14120) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.829450+0000 mon.smithi005 (mon.0) 44 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.832371+0000 mon.smithi005 (mon.0) 45 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.836177+0000 mon.smithi005 (mon.0) 46 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.840124+0000 mon.smithi005 (mon.0) 47 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.850568+0000 mon.smithi005 (mon.0) 48 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/mirror_snapshot_schedule"}]: dispatch 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:19.853898+0000 mon.smithi005 (mon.0) 49 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/trash_purge_schedule"}]: dispatch 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:20.004919+0000 mon.smithi005 (mon.0) 50 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: audit 2024-03-21T13:18:20.008594+0000 mon.smithi005 (mon.0) 51 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:21.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:20 smithi005 bash[18615]: cluster 2024-03-21T13:18:20.779216+0000 mon.smithi005 (mon.0) 52 : cluster [DBG] mgrmap e7: smithi005.rupoiq(active, since 1.01249s) 2024-03-21T13:18:21.422 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:18:21.422 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-21T13:18:21.422 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-21T13:18:21.422 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:18:21.422 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-03-21T13:18:21.423 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: audit 2024-03-21T13:18:20.778191+0000 mgr.smithi005.rupoiq (mgr.14120) 2 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: audit 2024-03-21T13:18:20.793512+0000 mgr.smithi005.rupoiq (mgr.14120) 3 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: cephadm 2024-03-21T13:18:20.881223+0000 mgr.smithi005.rupoiq (mgr.14120) 4 : cephadm [INF] [21/Mar/2024:13:18:20] ENGINE Bus STARTING 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: cephadm 2024-03-21T13:18:20.998945+0000 mgr.smithi005.rupoiq (mgr.14120) 5 : cephadm [INF] [21/Mar/2024:13:18:20] ENGINE Serving on https://172.21.15.5:7150 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: cephadm 2024-03-21T13:18:21.100182+0000 mgr.smithi005.rupoiq (mgr.14120) 6 : cephadm [INF] [21/Mar/2024:13:18:21] ENGINE Serving on http://172.21.15.5:8765 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: cephadm 2024-03-21T13:18:21.100343+0000 mgr.smithi005.rupoiq (mgr.14120) 7 : cephadm [INF] [21/Mar/2024:13:18:21] ENGINE Bus STARTED 2024-03-21T13:18:22.093 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:21 smithi005 bash[18615]: audit 2024-03-21T13:18:21.111541+0000 mon.smithi005 (mon.0) 53 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:18:23.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:22 smithi005 bash[18615]: cluster 2024-03-21T13:18:21.836175+0000 mon.smithi005 (mon.0) 54 : cluster [DBG] mgrmap e8: smithi005.rupoiq(active, since 2s) 2024-03-21T13:18:23.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:22 smithi005 bash[18615]: audit 2024-03-21T13:18:22.692916+0000 mon.smithi005 (mon.0) 55 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:23.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:22 smithi005 bash[18615]: audit 2024-03-21T13:18:22.732688+0000 mon.smithi005 (mon.0) 56 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:18:24.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:23 smithi005 bash[18615]: audit 2024-03-21T13:18:22.686099+0000 mgr.smithi005.rupoiq (mgr.14120) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:25.000 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-21T13:18:25.000 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-03-21T13:18:25.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:24 smithi005 bash[18615]: audit 2024-03-21T13:18:24.426401+0000 mgr.smithi005.rupoiq (mgr.14120) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:26.786 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:26 smithi005 bash[18615]: audit 2024-03-21T13:18:26.212179+0000 mgr.smithi005.rupoiq (mgr.14120) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:26.787 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:26 smithi005 bash[18615]: cephadm 2024-03-21T13:18:26.212550+0000 mgr.smithi005.rupoiq (mgr.14120) 11 : cephadm [INF] Generating ssh key... 2024-03-21T13:18:28.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:27 smithi005 bash[18615]: audit 2024-03-21T13:18:26.762175+0000 mon.smithi005 (mon.0) 57 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:28.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:27 smithi005 bash[18615]: audit 2024-03-21T13:18:26.766955+0000 mon.smithi005 (mon.0) 58 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:29.003 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5T2AJq64nW0AjL2EJA9l3pFXcOlfnBeP9H0b2ZwVYiNeSPZzKTmpaYy3eRl1jHxXLGwWQqsebg/74f8cR3ClMOUsCXGNgTHGUdPRKLVagogue9xWGsiYjWa2hJ90CO9WaVfUsNOtr0LN+g+zNNb9gqMtidek0Nxb28eeQ1eDVXluaDEGyVlQvi48HW3jyRGlQFy5rcX/wkZeiOP6oCQhbNWz/l2xNE4i6eBZmqZaD0e/O5rS1IUzoOGUuayJMwhsJQou7I1mjustgBz/OWqwYCNs7WpPf9IQm7ZQ2xc7529S6rywrGxxDlQtCwaN5KLfx/erLUmqnyKrDHz5fLwCJg8g32vyzNzX032oK0LwMAKRpB294qKW7ue+LPCG3Nz6ASAXKTeRt6jbrjloVr8gWYCjFvIL0TX8ixXJ+S2HMVqEYpZ8zsJFCarTrWJzL4k7+Hst5TAl181U27PoJNs1ZNEj9IXldvLzGFktJcesHitBObnqDDoumqcZMqvGJTN8= ceph-3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:18:29.004 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-21T13:18:29.004 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-03-21T13:18:29.004 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-03-21T13:18:29.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:29 smithi005 bash[18615]: audit 2024-03-21T13:18:28.497695+0000 mgr.smithi005.rupoiq (mgr.14120) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:30.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:30 smithi005 bash[18615]: audit 2024-03-21T13:18:30.289746+0000 mgr.smithi005.rupoiq (mgr.14120) 13 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:31.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:31 smithi005 bash[18615]: cephadm 2024-03-21T13:18:30.986851+0000 mgr.smithi005.rupoiq (mgr.14120) 14 : cephadm [INF] Deploying cephadm binary to smithi005 2024-03-21T13:18:37.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-03-21T13:18:37.053 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying mon service with default placement... 2024-03-21T13:18:37.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:37 smithi005 bash[18615]: audit 2024-03-21T13:18:36.301423+0000 mon.smithi005 (mon.0) 59 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:37.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:37 smithi005 bash[18615]: cephadm 2024-03-21T13:18:36.302162+0000 mgr.smithi005.rupoiq (mgr.14120) 15 : cephadm [INF] Added host smithi005 2024-03-21T13:18:37.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:37 smithi005 bash[18615]: audit 2024-03-21T13:18:36.319093+0000 mon.smithi005 (mon.0) 60 : audit [DBG] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:18:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-21T13:18:39.609 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying mgr service with default placement... 2024-03-21T13:18:40.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:39 smithi005 bash[18615]: audit 2024-03-21T13:18:38.851590+0000 mgr.smithi005.rupoiq (mgr.14120) 16 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:40.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:39 smithi005 bash[18615]: cephadm 2024-03-21T13:18:38.854647+0000 mgr.smithi005.rupoiq (mgr.14120) 17 : cephadm [INF] Saving service mon spec with placement count:5 2024-03-21T13:18:40.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:39 smithi005 bash[18615]: audit 2024-03-21T13:18:38.858069+0000 mon.smithi005 (mon.0) 61 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:40.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:39 smithi005 bash[18615]: audit 2024-03-21T13:18:39.345027+0000 mon.smithi005 (mon.0) 62 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:40 smithi005 bash[18615]: cluster 2024-03-21T13:18:39.782855+0000 mgr.smithi005.rupoiq (mgr.14120) 18 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:40 smithi005 bash[18615]: audit 2024-03-21T13:18:39.883151+0000 mon.smithi005 (mon.0) 63 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:40 smithi005 bash[18615]: audit 2024-03-21T13:18:40.836182+0000 mon.smithi005 (mon.0) 64 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:41.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-21T13:18:41.392 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying crash service with default placement... 2024-03-21T13:18:42.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:41 smithi005 bash[18615]: audit 2024-03-21T13:18:40.829242+0000 mgr.smithi005.rupoiq (mgr.14120) 19 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:42.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:41 smithi005 bash[18615]: cephadm 2024-03-21T13:18:40.831579+0000 mgr.smithi005.rupoiq (mgr.14120) 20 : cephadm [INF] Saving service mgr spec with placement count:2 2024-03-21T13:18:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:42 smithi005 bash[18615]: cluster 2024-03-21T13:18:41.783302+0000 mgr.smithi005.rupoiq (mgr.14120) 21 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:42 smithi005 bash[18615]: audit 2024-03-21T13:18:42.662620+0000 mon.smithi005 (mon.0) 65 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:43.289 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-03-21T13:18:43.290 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying ceph-exporter service with default placement... 2024-03-21T13:18:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:43 smithi005 bash[18615]: audit 2024-03-21T13:18:42.655908+0000 mgr.smithi005.rupoiq (mgr.14120) 22 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:43 smithi005 bash[18615]: cephadm 2024-03-21T13:18:42.658118+0000 mgr.smithi005.rupoiq (mgr.14120) 23 : cephadm [INF] Saving service crash spec with placement * 2024-03-21T13:18:45.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-03-21T13:18:45.153 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying prometheus service with default placement... 2024-03-21T13:18:45.178 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:44 smithi005 bash[18615]: cluster 2024-03-21T13:18:43.783884+0000 mgr.smithi005.rupoiq (mgr.14120) 24 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:45.178 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:44 smithi005 bash[18615]: audit 2024-03-21T13:18:44.544852+0000 mon.smithi005 (mon.0) 66 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:46.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:45 smithi005 bash[18615]: audit 2024-03-21T13:18:44.539432+0000 mgr.smithi005.rupoiq (mgr.14120) 25 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:46.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:45 smithi005 bash[18615]: cephadm 2024-03-21T13:18:44.541232+0000 mgr.smithi005.rupoiq (mgr.14120) 26 : cephadm [INF] Saving service ceph-exporter spec with placement * 2024-03-21T13:18:47.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-03-21T13:18:47.026 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying grafana service with default placement... 2024-03-21T13:18:47.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:47 smithi005 bash[18615]: cluster 2024-03-21T13:18:45.784230+0000 mgr.smithi005.rupoiq (mgr.14120) 27 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:47.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:47 smithi005 bash[18615]: audit 2024-03-21T13:18:46.456006+0000 mgr.smithi005.rupoiq (mgr.14120) 28 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:47.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:47 smithi005 bash[18615]: cephadm 2024-03-21T13:18:46.458414+0000 mgr.smithi005.rupoiq (mgr.14120) 29 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-03-21T13:18:47.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:47 smithi005 bash[18615]: audit 2024-03-21T13:18:46.461546+0000 mon.smithi005 (mon.0) 67 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:48.913 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-03-21T13:18:48.913 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying node-exporter service with default placement... 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: audit 2024-03-21T13:18:47.768277+0000 mon.smithi005 (mon.0) 68 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: cluster 2024-03-21T13:18:47.784485+0000 mgr.smithi005.rupoiq (mgr.14120) 30 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: audit 2024-03-21T13:18:48.287844+0000 mgr.smithi005.rupoiq (mgr.14120) 31 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: cephadm 2024-03-21T13:18:48.291978+0000 mgr.smithi005.rupoiq (mgr.14120) 32 : cephadm [INF] Saving service grafana spec with placement count:1 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: audit 2024-03-21T13:18:48.300016+0000 mon.smithi005 (mon.0) 69 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:49.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:48 smithi005 bash[18615]: audit 2024-03-21T13:18:48.753224+0000 mon.smithi005 (mon.0) 70 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:50.703 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-03-21T13:18:50.703 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying alertmanager service with default placement... 2024-03-21T13:18:51.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:51 smithi005 bash[18615]: cluster 2024-03-21T13:18:49.784690+0000 mgr.smithi005.rupoiq (mgr.14120) 33 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:51.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:51 smithi005 bash[18615]: audit 2024-03-21T13:18:50.191194+0000 mgr.smithi005.rupoiq (mgr.14120) 34 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:51.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:51 smithi005 bash[18615]: cephadm 2024-03-21T13:18:50.194118+0000 mgr.smithi005.rupoiq (mgr.14120) 35 : cephadm [INF] Saving service node-exporter spec with placement * 2024-03-21T13:18:51.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:51 smithi005 bash[18615]: audit 2024-03-21T13:18:50.198665+0000 mon.smithi005 (mon.0) 71 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:52.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-03-21T13:18:53.251 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:52 smithi005 bash[18615]: cluster 2024-03-21T13:18:51.784929+0000 mgr.smithi005.rupoiq (mgr.14120) 36 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:53.251 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:52 smithi005 bash[18615]: audit 2024-03-21T13:18:51.966267+0000 mgr.smithi005.rupoiq (mgr.14120) 37 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:18:53.251 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:52 smithi005 bash[18615]: cephadm 2024-03-21T13:18:51.968256+0000 mgr.smithi005.rupoiq (mgr.14120) 38 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-03-21T13:18:53.252 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:52 smithi005 bash[18615]: audit 2024-03-21T13:18:51.971831+0000 mon.smithi005 (mon.0) 72 : audit [INF] from='mgr.14120 172.21.15.5:0/820640574' entity='mgr.smithi005.rupoiq' 2024-03-21T13:18:55.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:54 smithi005 bash[18615]: cluster 2024-03-21T13:18:53.785280+0000 mgr.smithi005.rupoiq (mgr.14120) 39 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:55.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:54 smithi005 bash[18615]: audit 2024-03-21T13:18:53.837558+0000 mon.smithi005 (mon.0) 73 : audit [INF] from='client.? 172.21.15.5:0/1680804433' entity='client.admin' 2024-03-21T13:18:56.807 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-03-21T13:18:57.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:57 smithi005 bash[18615]: cluster 2024-03-21T13:18:55.785527+0000 mgr.smithi005.rupoiq (mgr.14120) 40 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:57.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:57 smithi005 bash[18615]: audit 2024-03-21T13:18:56.015212+0000 mon.smithi005 (mon.0) 74 : audit [INF] from='client.? 172.21.15.5:0/1094910567' entity='client.admin' 2024-03-21T13:18:59.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:59 smithi005 bash[18615]: cluster 2024-03-21T13:18:57.785867+0000 mgr.smithi005.rupoiq (mgr.14120) 41 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:18:59.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:18:59 smithi005 bash[18615]: audit 2024-03-21T13:18:58.175120+0000 mon.smithi005 (mon.0) 75 : audit [INF] from='client.? 172.21.15.5:0/2268370688' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-21T13:19:00.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:00 smithi005 bash[18615]: audit 2024-03-21T13:18:59.019102+0000 mon.smithi005 (mon.0) 76 : audit [INF] from='client.? 172.21.15.5:0/2268370688' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-21T13:19:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:00 smithi005 bash[18615]: cluster 2024-03-21T13:18:59.024743+0000 mon.smithi005 (mon.0) 77 : cluster [DBG] mgrmap e9: smithi005.rupoiq(active, since 39s) 2024-03-21T13:19:01.127 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:01 smithi005 bash[18615]: audit 2024-03-21T13:19:00.901016+0000 mon.smithi005 (mon.0) 78 : audit [DBG] from='client.? 172.21.15.5:0/194402541' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-21T13:19:01.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:19:01.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "smithi005.rupoiq", 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-03-21T13:19:01.469 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-03-21T13:19:07.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: cluster 2024-03-21T13:19:07.445427+0000 mon.smithi005 (mon.0) 79 : cluster [INF] Active manager daemon smithi005.rupoiq restarted 2024-03-21T13:19:07.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: cluster 2024-03-21T13:19:07.445880+0000 mon.smithi005 (mon.0) 80 : cluster [INF] Activating manager daemon smithi005.rupoiq 2024-03-21T13:19:07.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: cluster 2024-03-21T13:19:07.453326+0000 mon.smithi005 (mon.0) 81 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-03-21T13:19:07.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: cluster 2024-03-21T13:19:07.453578+0000 mon.smithi005 (mon.0) 82 : cluster [DBG] mgrmap e10: smithi005.rupoiq(active, starting, since 0.00788108s) 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: audit 2024-03-21T13:19:07.455962+0000 mon.smithi005 (mon.0) 83 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: audit 2024-03-21T13:19:07.458111+0000 mon.smithi005 (mon.0) 84 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi005.rupoiq", "id": "smithi005.rupoiq"}]: dispatch 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: audit 2024-03-21T13:19:07.458993+0000 mon.smithi005 (mon.0) 85 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: audit 2024-03-21T13:19:07.459156+0000 mon.smithi005 (mon.0) 86 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: audit 2024-03-21T13:19:07.459293+0000 mon.smithi005 (mon.0) 87 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-21T13:19:07.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:07 smithi005 bash[18615]: cluster 2024-03-21T13:19:07.481994+0000 mon.smithi005 (mon.0) 88 : cluster [INF] Manager daemon smithi005.rupoiq is now available 2024-03-21T13:19:08.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:08 smithi005 bash[18615]: audit 2024-03-21T13:19:07.507925+0000 mon.smithi005 (mon.0) 89 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:19:08.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:08 smithi005 bash[18615]: audit 2024-03-21T13:19:07.526511+0000 mon.smithi005 (mon.0) 90 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/mirror_snapshot_schedule"}]: dispatch 2024-03-21T13:19:08.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:08 smithi005 bash[18615]: audit 2024-03-21T13:19:07.530024+0000 mon.smithi005 (mon.0) 91 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/trash_purge_schedule"}]: dispatch 2024-03-21T13:19:08.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:08 smithi005 bash[18615]: cluster 2024-03-21T13:19:08.458529+0000 mon.smithi005 (mon.0) 92 : cluster [DBG] mgrmap e11: smithi005.rupoiq(active, since 1.01283s) 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-03-21T13:19:09.050 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2024-03-21T13:19:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:09 smithi005 bash[18615]: cephadm 2024-03-21T13:19:08.461194+0000 mgr.smithi005.rupoiq (mgr.14164) 2 : cephadm [INF] [21/Mar/2024:13:19:08] ENGINE Bus STARTING 2024-03-21T13:19:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:09 smithi005 bash[18615]: audit 2024-03-21T13:19:08.468223+0000 mgr.smithi005.rupoiq (mgr.14164) 3 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-21T13:19:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:09 smithi005 bash[18615]: cephadm 2024-03-21T13:19:08.583790+0000 mgr.smithi005.rupoiq (mgr.14164) 4 : cephadm [INF] [21/Mar/2024:13:19:08] ENGINE Serving on https://172.21.15.5:7150 2024-03-21T13:19:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:09 smithi005 bash[18615]: cephadm 2024-03-21T13:19:08.685079+0000 mgr.smithi005.rupoiq (mgr.14164) 5 : cephadm [INF] [21/Mar/2024:13:19:08] ENGINE Serving on http://172.21.15.5:8765 2024-03-21T13:19:09.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:09 smithi005 bash[18615]: cephadm 2024-03-21T13:19:08.685297+0000 mgr.smithi005.rupoiq (mgr.14164) 6 : cephadm [INF] [21/Mar/2024:13:19:08] ENGINE Bus STARTED 2024-03-21T13:19:10.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:10 smithi005 bash[18615]: cluster 2024-03-21T13:19:09.506763+0000 mon.smithi005 (mon.0) 93 : cluster [DBG] mgrmap e12: smithi005.rupoiq(active, since 2s) 2024-03-21T13:19:10.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:10 smithi005 bash[18615]: audit 2024-03-21T13:19:10.380899+0000 mon.smithi005 (mon.0) 94 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:10.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:10 smithi005 bash[18615]: audit 2024-03-21T13:19:10.383400+0000 mon.smithi005 (mon.0) 95 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:10.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-21T13:19:10.963 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-03-21T13:19:11.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:11 smithi005 bash[18615]: audit 2024-03-21T13:19:10.268678+0000 mgr.smithi005.rupoiq (mgr.14164) 7 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:19:13.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$G/TW2mLUPBOrwuLINmGev.OznNZa9XuA4X7IQXT84FA7PAR0FXgGO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711027152, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-21T13:19:13.094 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-03-21T13:19:13.736 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:13 smithi005 bash[18615]: audit 2024-03-21T13:19:12.200734+0000 mgr.smithi005.rupoiq (mgr.14164) 8 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:19:13.736 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:13 smithi005 bash[18615]: audit 2024-03-21T13:19:12.479698+0000 mon.smithi005 (mon.0) 96 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:14.873 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-03-21T13:19:14.873 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld does not appear to be present 2024-03-21T13:19:14.873 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005:8443/ 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: Password: zilrjwjbgv 2024-03-21T13:19:14.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:14.877 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config directory 2024-03-21T13:19:14.877 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling autotune for osd_memory_target 2024-03-21T13:19:15.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:15 smithi005 bash[18615]: audit 2024-03-21T13:19:14.224909+0000 mon.smithi005 (mon.0) 97 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:15.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:15 smithi005 bash[18615]: audit 2024-03-21T13:19:14.317923+0000 mon.smithi005 (mon.0) 98 : audit [DBG] from='client.? 172.21.15.5:0/3272027958' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-21T13:19:15.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:15 smithi005 bash[18615]: cluster 2024-03-21T13:19:14.485859+0000 mon.smithi005 (mon.0) 99 : cluster [DBG] mgrmap e13: smithi005.rupoiq(active, since 7s) 2024-03-21T13:19:16.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:16 smithi005 bash[18615]: audit 2024-03-21T13:19:15.377374+0000 mon.smithi005 (mon.0) 100 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:18.675 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-21T13:19:18.675 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-21T13:19:18.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.675 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:19:18.676 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-03-21T13:19:18.719 INFO:tasks.cephadm:Fetching config... 2024-03-21T13:19:18.719 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:19:18.719 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-21T13:19:18.725 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-21T13:19:18.725 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:19:18.726 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-21T13:19:18.774 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-21T13:19:18.775 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:19:18.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/keyring of=/dev/stdout 2024-03-21T13:19:18.829 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-21T13:19:18.829 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:19:18.829 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-21T13:19:18.874 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-21T13:19:18.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5T2AJq64nW0AjL2EJA9l3pFXcOlfnBeP9H0b2ZwVYiNeSPZzKTmpaYy3eRl1jHxXLGwWQqsebg/74f8cR3ClMOUsCXGNgTHGUdPRKLVagogue9xWGsiYjWa2hJ90CO9WaVfUsNOtr0LN+g+zNNb9gqMtidek0Nxb28eeQ1eDVXluaDEGyVlQvi48HW3jyRGlQFy5rcX/wkZeiOP6oCQhbNWz/l2xNE4i6eBZmqZaD0e/O5rS1IUzoOGUuayJMwhsJQou7I1mjustgBz/OWqwYCNs7WpPf9IQm7ZQ2xc7529S6rywrGxxDlQtCwaN5KLfx/erLUmqnyKrDHz5fLwCJg8g32vyzNzX032oK0LwMAKRpB294qKW7ue+LPCG3Nz6ASAXKTeRt6jbrjloVr8gWYCjFvIL0TX8ixXJ+S2HMVqEYpZ8zsJFCarTrWJzL4k7+Hst5TAl181U27PoJNs1ZNEj9IXldvLzGFktJcesHitBObnqDDoumqcZMqvGJTN8= ceph-3164d712-e785-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-21T13:19:18.937 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5T2AJq64nW0AjL2EJA9l3pFXcOlfnBeP9H0b2ZwVYiNeSPZzKTmpaYy3eRl1jHxXLGwWQqsebg/74f8cR3ClMOUsCXGNgTHGUdPRKLVagogue9xWGsiYjWa2hJ90CO9WaVfUsNOtr0LN+g+zNNb9gqMtidek0Nxb28eeQ1eDVXluaDEGyVlQvi48HW3jyRGlQFy5rcX/wkZeiOP6oCQhbNWz/l2xNE4i6eBZmqZaD0e/O5rS1IUzoOGUuayJMwhsJQou7I1mjustgBz/OWqwYCNs7WpPf9IQm7ZQ2xc7529S6rywrGxxDlQtCwaN5KLfx/erLUmqnyKrDHz5fLwCJg8g32vyzNzX032oK0LwMAKRpB294qKW7ue+LPCG3Nz6ASAXKTeRt6jbrjloVr8gWYCjFvIL0TX8ixXJ+S2HMVqEYpZ8zsJFCarTrWJzL4k7+Hst5TAl181U27PoJNs1ZNEj9IXldvLzGFktJcesHitBObnqDDoumqcZMqvGJTN8= ceph-3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:19:18.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5T2AJq64nW0AjL2EJA9l3pFXcOlfnBeP9H0b2ZwVYiNeSPZzKTmpaYy3eRl1jHxXLGwWQqsebg/74f8cR3ClMOUsCXGNgTHGUdPRKLVagogue9xWGsiYjWa2hJ90CO9WaVfUsNOtr0LN+g+zNNb9gqMtidek0Nxb28eeQ1eDVXluaDEGyVlQvi48HW3jyRGlQFy5rcX/wkZeiOP6oCQhbNWz/l2xNE4i6eBZmqZaD0e/O5rS1IUzoOGUuayJMwhsJQou7I1mjustgBz/OWqwYCNs7WpPf9IQm7ZQ2xc7529S6rywrGxxDlQtCwaN5KLfx/erLUmqnyKrDHz5fLwCJg8g32vyzNzX032oK0LwMAKRpB294qKW7ue+LPCG3Nz6ASAXKTeRt6jbrjloVr8gWYCjFvIL0TX8ixXJ+S2HMVqEYpZ8zsJFCarTrWJzL4k7+Hst5TAl181U27PoJNs1ZNEj9IXldvLzGFktJcesHitBObnqDDoumqcZMqvGJTN8= ceph-3164d712-e785-11ee-95cd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-21T13:19:18.972 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5T2AJq64nW0AjL2EJA9l3pFXcOlfnBeP9H0b2ZwVYiNeSPZzKTmpaYy3eRl1jHxXLGwWQqsebg/74f8cR3ClMOUsCXGNgTHGUdPRKLVagogue9xWGsiYjWa2hJ90CO9WaVfUsNOtr0LN+g+zNNb9gqMtidek0Nxb28eeQ1eDVXluaDEGyVlQvi48HW3jyRGlQFy5rcX/wkZeiOP6oCQhbNWz/l2xNE4i6eBZmqZaD0e/O5rS1IUzoOGUuayJMwhsJQou7I1mjustgBz/OWqwYCNs7WpPf9IQm7ZQ2xc7529S6rywrGxxDlQtCwaN5KLfx/erLUmqnyKrDHz5fLwCJg8g32vyzNzX032oK0LwMAKRpB294qKW7ue+LPCG3Nz6ASAXKTeRt6jbrjloVr8gWYCjFvIL0TX8ixXJ+S2HMVqEYpZ8zsJFCarTrWJzL4k7+Hst5TAl181U27PoJNs1ZNEj9IXldvLzGFktJcesHitBObnqDDoumqcZMqvGJTN8= ceph-3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:19:18.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-21T13:19:19.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:19 smithi005 bash[18615]: audit 2024-03-21T13:19:18.129219+0000 mon.smithi005 (mon.0) 101 : audit [INF] from='client.? 172.21.15.5:0/159045917' entity='client.admin' 2024-03-21T13:19:23.666 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:19:27.799 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.321717+0000 mon.smithi005 (mon.0) 102 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:27.799 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.324678+0000 mon.smithi005 (mon.0) 103 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:27.799 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.325557+0000 mon.smithi005 (mon.0) 104 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.329557+0000 mon.smithi005 (mon.0) 105 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.331408+0000 mon.smithi005 (mon.0) 106 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi005", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.332276+0000 mon.smithi005 (mon.0) 107 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi005", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.336009+0000 mon.smithi005 (mon.0) 108 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: cephadm 2024-03-21T13:19:26.337360+0000 mgr.smithi005.rupoiq (mgr.14164) 9 : cephadm [INF] Deploying daemon ceph-exporter.smithi005 on smithi005 2024-03-21T13:19:27.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:27 smithi005 bash[18615]: audit 2024-03-21T13:19:26.702547+0000 mon.smithi005 (mon.0) 109 : audit [INF] from='client.? 172.21.15.5:0/3992887083' entity='client.admin' 2024-03-21T13:19:27.801 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-21T13:19:27.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-21T13:19:28.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:28 smithi005 bash[18615]: cluster 2024-03-21T13:19:27.460737+0000 mgr.smithi005.rupoiq (mgr.14164) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:28.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:28 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:29.173 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:29 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.165299+0000 mon.smithi005 (mon.0) 110 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.167954+0000 mon.smithi005 (mon.0) 111 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.210344+0000 mon.smithi005 (mon.0) 112 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.213017+0000 mon.smithi005 (mon.0) 113 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.214336+0000 mon.smithi005 (mon.0) 114 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.215053+0000 mon.smithi005 (mon.0) 115 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: audit 2024-03-21T13:19:29.217001+0000 mon.smithi005 (mon.0) 116 : audit [DBG] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: cephadm 2024-03-21T13:19:29.217754+0000 mgr.smithi005.rupoiq (mgr.14164) 11 : cephadm [INF] Deploying daemon crash.smithi005 on smithi005 2024-03-21T13:19:30.468 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:30 smithi005 bash[18615]: cluster 2024-03-21T13:19:29.461145+0000 mgr.smithi005.rupoiq (mgr.14164) 12 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:31.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:31 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:32.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:31 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:32.508 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:19:32.796 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: cluster 2024-03-21T13:19:31.461553+0000 mgr.smithi005.rupoiq (mgr.14164) 13 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: audit 2024-03-21T13:19:31.755127+0000 mon.smithi005 (mon.0) 117 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: audit 2024-03-21T13:19:31.758223+0000 mon.smithi005 (mon.0) 118 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: audit 2024-03-21T13:19:31.789344+0000 mon.smithi005 (mon.0) 119 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: audit 2024-03-21T13:19:31.791481+0000 mon.smithi005 (mon.0) 120 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: cephadm 2024-03-21T13:19:31.792776+0000 mgr.smithi005.rupoiq (mgr.14164) 14 : cephadm [INF] Deploying daemon node-exporter.smithi005 on smithi005 2024-03-21T13:19:32.797 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 bash[18615]: audit 2024-03-21T13:19:32.526437+0000 mon.smithi005 (mon.0) 121 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:33.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:32 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:34.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:33 smithi005 bash[18615]: audit 2024-03-21T13:19:32.947217+0000 mon.smithi005 (mon.0) 122 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:34.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:33 smithi005 bash[18615]: audit 2024-03-21T13:19:32.949737+0000 mon.smithi005 (mon.0) 123 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:34.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:33 smithi005 bash[18615]: audit 2024-03-21T13:19:32.959905+0000 mon.smithi005 (mon.0) 124 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:34.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:33 smithi005 bash[18615]: audit 2024-03-21T13:19:32.961945+0000 mon.smithi005 (mon.0) 125 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:34.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:33 smithi005 bash[18615]: cephadm 2024-03-21T13:19:32.973184+0000 mgr.smithi005.rupoiq (mgr.14164) 15 : cephadm [INF] Deploying daemon alertmanager.smithi005 on smithi005 2024-03-21T13:19:35.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:34 smithi005 bash[18615]: cluster 2024-03-21T13:19:33.461927+0000 mgr.smithi005.rupoiq (mgr.14164) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:37.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:36 smithi005 bash[18615]: cluster 2024-03-21T13:19:35.462355+0000 mgr.smithi005.rupoiq (mgr.14164) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:37.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:36 smithi005 bash[18615]: audit 2024-03-21T13:19:36.090248+0000 mgr.smithi005.rupoiq (mgr.14164) 18 : audit [DBG] from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:19:37.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:36 smithi005 bash[18615]: audit 2024-03-21T13:19:36.093395+0000 mon.smithi005 (mon.0) 126 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:37.593 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-03-21T13:19:37.593 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:19:37.593 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-03-21T13:19:37.600 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:19:37.600 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-21T13:19:37.647 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-03-21T13:19:37.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch host add smithi157 2024-03-21T13:19:38.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:38 smithi005 bash[18615]: cluster 2024-03-21T13:19:37.462821+0000 mgr.smithi005.rupoiq (mgr.14164) 19 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:38.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:38 smithi005 bash[18615]: audit 2024-03-21T13:19:37.532788+0000 mon.smithi005 (mon.0) 127 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:40.679 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:40 smithi005 bash[18615]: cluster 2024-03-21T13:19:39.463212+0000 mgr.smithi005.rupoiq (mgr.14164) 20 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:42.786 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:42 smithi005 bash[18615]: cluster 2024-03-21T13:19:41.463529+0000 mgr.smithi005.rupoiq (mgr.14164) 21 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:43.380 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:43 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:43.511 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:19:43.648 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:43 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: cluster 2024-03-21T13:19:43.463836+0000 mgr.smithi005.rupoiq (mgr.14164) 22 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.648402+0000 mon.smithi005 (mon.0) 128 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.651608+0000 mon.smithi005 (mon.0) 129 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.662017+0000 mon.smithi005 (mon.0) 130 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.664157+0000 mon.smithi005 (mon.0) 131 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.666726+0000 mon.smithi005 (mon.0) 132 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.668414+0000 mon.smithi005 (mon.0) 133 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: cephadm 2024-03-21T13:19:43.678245+0000 mgr.smithi005.rupoiq (mgr.14164) 23 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-03-21T13:19:44.911 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.854891+0000 mon.smithi005 (mon.0) 134 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.859367+0000 mon.smithi005 (mon.0) 135 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.861820+0000 mon.smithi005 (mon.0) 136 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-21T13:19:44.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.862672+0000 mgr.smithi005.rupoiq (mgr.14164) 24 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-21T13:19:44.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: audit 2024-03-21T13:19:43.866478+0000 mon.smithi005 (mon.0) 137 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:44.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:44 smithi005 bash[18615]: cephadm 2024-03-21T13:19:43.885704+0000 mgr.smithi005.rupoiq (mgr.14164) 25 : cephadm [INF] Deploying daemon grafana.smithi005 on smithi005 2024-03-21T13:19:46.902 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:46 smithi005 bash[18615]: cluster 2024-03-21T13:19:45.464188+0000 mgr.smithi005.rupoiq (mgr.14164) 26 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:48.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:48 smithi005 bash[18615]: audit 2024-03-21T13:19:47.324867+0000 mgr.smithi005.rupoiq (mgr.14164) 27 : audit [DBG] from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:19:48.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:48 smithi005 bash[18615]: cluster 2024-03-21T13:19:47.464544+0000 mgr.smithi005.rupoiq (mgr.14164) 28 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:48.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:48 smithi005 bash[18615]: audit 2024-03-21T13:19:47.537725+0000 mon.smithi005 (mon.0) 138 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:48.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:48 smithi005 bash[18615]: cephadm 2024-03-21T13:19:48.037493+0000 mgr.smithi005.rupoiq (mgr.14164) 29 : cephadm [INF] Deploying cephadm binary to smithi157 2024-03-21T13:19:50.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:50 smithi005 bash[18615]: cluster 2024-03-21T13:19:49.464837+0000 mgr.smithi005.rupoiq (mgr.14164) 30 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:52.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:52 smithi005 bash[18615]: cluster 2024-03-21T13:19:51.465199+0000 mgr.smithi005.rupoiq (mgr.14164) 31 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:53.650 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-03-21T13:19:54.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch host ls --format=json 2024-03-21T13:19:54.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:54 smithi005 bash[18615]: cluster 2024-03-21T13:19:53.465601+0000 mgr.smithi005.rupoiq (mgr.14164) 32 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:54.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:54 smithi005 bash[18615]: audit 2024-03-21T13:19:53.649849+0000 mon.smithi005 (mon.0) 139 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:54.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:54 smithi005 bash[18615]: cephadm 2024-03-21T13:19:53.650745+0000 mgr.smithi005.rupoiq (mgr.14164) 33 : cephadm [INF] Added host smithi157 2024-03-21T13:19:56.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:56 smithi005 bash[18615]: cluster 2024-03-21T13:19:55.466022+0000 mgr.smithi005.rupoiq (mgr.14164) 34 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:57.457 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:57 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:57.730 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:57 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:19:59.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: cluster 2024-03-21T13:19:57.466340+0000 mgr.smithi005.rupoiq (mgr.14164) 35 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.729549+0000 mon.smithi005 (mon.0) 140 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.733114+0000 mon.smithi005 (mon.0) 141 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.751784+0000 mon.smithi005 (mon.0) 142 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.754132+0000 mon.smithi005 (mon.0) 143 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.756825+0000 mon.smithi005 (mon.0) 144 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.759534+0000 mon.smithi005 (mon.0) 145 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.762235+0000 mon.smithi005 (mon.0) 146 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: audit 2024-03-21T13:19:57.764122+0000 mon.smithi005 (mon.0) 147 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:19:59.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:19:58 smithi005 bash[18615]: cephadm 2024-03-21T13:19:58.022375+0000 mgr.smithi005.rupoiq (mgr.14164) 36 : cephadm [INF] Deploying daemon prometheus.smithi005 on smithi005 2024-03-21T13:20:00.607 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:20:01.026 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:00 smithi005 bash[18615]: cluster 2024-03-21T13:19:59.466731+0000 mgr.smithi005.rupoiq (mgr.14164) 37 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:02.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:02 smithi005 bash[18615]: cluster 2024-03-21T13:20:01.467160+0000 mgr.smithi005.rupoiq (mgr.14164) 38 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:02.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:02 smithi005 bash[18615]: audit 2024-03-21T13:20:02.545043+0000 mon.smithi005 (mon.0) 148 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:05.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:04 smithi005 bash[18615]: cluster 2024-03-21T13:20:03.467480+0000 mgr.smithi005.rupoiq (mgr.14164) 39 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:07.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:06 smithi005 bash[18615]: cluster 2024-03-21T13:20:05.467937+0000 mgr.smithi005.rupoiq (mgr.14164) 40 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:07.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:20:07.788 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-03-21T13:20:08.770 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:08 smithi005 bash[18615]: cluster 2024-03-21T13:20:07.468229+0000 mgr.smithi005.rupoiq (mgr.14164) 41 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:08.770 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:08 smithi005 bash[18615]: audit 2024-03-21T13:20:07.788177+0000 mgr.smithi005.rupoiq (mgr.14164) 42 : audit [DBG] from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:20:08.868 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-21T13:20:08.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd crush tunables default 2024-03-21T13:20:10.855 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:10 smithi005 bash[18615]: cluster 2024-03-21T13:20:09.468670+0000 mgr.smithi005.rupoiq (mgr.14164) 43 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:12.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:12 smithi005 bash[18615]: cluster 2024-03-21T13:20:11.469116+0000 mgr.smithi005.rupoiq (mgr.14164) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:14.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:14 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:14.813 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:14 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:14.813 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:14 smithi005 bash[18615]: cluster 2024-03-21T13:20:13.469529+0000 mgr.smithi005.rupoiq (mgr.14164) 45 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:14.860 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:20:16.039 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:15 smithi005 bash[18615]: audit 2024-03-21T13:20:14.841985+0000 mon.smithi005 (mon.0) 149 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:16.039 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:15 smithi005 bash[18615]: audit 2024-03-21T13:20:14.844926+0000 mon.smithi005 (mon.0) 150 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:16.039 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:15 smithi005 bash[18615]: audit 2024-03-21T13:20:14.887779+0000 mon.smithi005 (mon.0) 151 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:16.039 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:15 smithi005 bash[18615]: audit 2024-03-21T13:20:14.889861+0000 mon.smithi005 (mon.0) 152 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-21T13:20:16.953 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:16 smithi005 bash[18615]: audit 2024-03-21T13:20:15.888216+0000 mon.smithi005 (mon.0) 153 : audit [INF] from='mgr.14164 172.21.15.5:0/4128872916' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-21T13:20:16.953 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:16 smithi005 bash[18615]: cluster 2024-03-21T13:20:15.893479+0000 mon.smithi005 (mon.0) 154 : cluster [DBG] mgrmap e14: smithi005.rupoiq(active, since 68s) 2024-03-21T13:20:19.519 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-03-21T13:20:19.529 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:19 smithi005 bash[18615]: audit 2024-03-21T13:20:19.465397+0000 mon.smithi005 (mon.0) 155 : audit [INF] from='client.? 172.21.15.5:0/2527093361' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-21T13:20:20.428 INFO:tasks.cephadm:Adding mon.smithi005 on smithi005 2024-03-21T13:20:20.428 INFO:tasks.cephadm:Adding mon.smithi157 on smithi157 2024-03-21T13:20:20.428 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch apply mon '2;smithi005:172.21.15.5=smithi005;smithi157:172.21.15.157=smithi157' 2024-03-21T13:20:20.706 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:20 smithi005 bash[18615]: audit 2024-03-21T13:20:19.516533+0000 mon.smithi005 (mon.0) 156 : audit [INF] from='client.? 172.21.15.5:0/2527093361' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-21T13:20:20.706 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:20 smithi005 bash[18615]: cluster 2024-03-21T13:20:19.518777+0000 mon.smithi005 (mon.0) 157 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-03-21T13:20:21.628 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-21T13:20:22.674 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: cluster 2024-03-21T13:20:24.409548+0000 mon.smithi005 (mon.0) 158 : cluster [INF] Active manager daemon smithi005.rupoiq restarted 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: cluster 2024-03-21T13:20:24.409820+0000 mon.smithi005 (mon.0) 159 : cluster [INF] Activating manager daemon smithi005.rupoiq 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: cluster 2024-03-21T13:20:24.415910+0000 mon.smithi005 (mon.0) 160 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: cluster 2024-03-21T13:20:24.416153+0000 mon.smithi005 (mon.0) 161 : cluster [DBG] mgrmap e15: smithi005.rupoiq(active, starting, since 0.00644297s) 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: audit 2024-03-21T13:20:24.419183+0000 mon.smithi005 (mon.0) 162 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: audit 2024-03-21T13:20:24.420531+0000 mon.smithi005 (mon.0) 163 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi005.rupoiq", "id": "smithi005.rupoiq"}]: dispatch 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: audit 2024-03-21T13:20:24.421427+0000 mon.smithi005 (mon.0) 164 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: audit 2024-03-21T13:20:24.421874+0000 mon.smithi005 (mon.0) 165 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: audit 2024-03-21T13:20:24.422261+0000 mon.smithi005 (mon.0) 166 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-21T13:20:24.682 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:24 smithi005 bash[18615]: cluster 2024-03-21T13:20:24.446184+0000 mon.smithi005 (mon.0) 167 : cluster [INF] Manager daemon smithi005.rupoiq is now available 2024-03-21T13:20:25.431 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mon update... 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:24.474078+0000 mon.smithi005 (mon.0) 168 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:24.491236+0000 mon.smithi005 (mon.0) 169 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:24.494318+0000 mon.smithi005 (mon.0) 170 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:24.504957+0000 mon.smithi005 (mon.0) 171 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/mirror_snapshot_schedule"}]: dispatch 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:24.509824+0000 mon.smithi005 (mon.0) 172 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.rupoiq/trash_purge_schedule"}]: dispatch 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:25.368660+0000 mon.smithi005 (mon.0) 173 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: cluster 2024-03-21T13:20:25.421711+0000 mon.smithi005 (mon.0) 174 : cluster [DBG] mgrmap e16: smithi005.rupoiq(active, since 1.012s) 2024-03-21T13:20:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:25 smithi005 bash[18615]: audit 2024-03-21T13:20:25.431647+0000 mon.smithi005 (mon.0) 175 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:26.056 DEBUG:teuthology.orchestra.run.smithi157:mon.smithi157> sudo journalctl -f -n 0 -u ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi157.service 2024-03-21T13:20:26.059 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-21T13:20:26.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-21T13:20:26.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:26 smithi005 bash[18615]: cephadm 2024-03-21T13:20:25.427258+0000 mgr.smithi005.rupoiq (mgr.14195) 2 : cephadm [INF] Saving service mon spec with placement smithi005:172.21.15.5=smithi005;smithi157:172.21.15.157=smithi157;count:2 2024-03-21T13:20:27.297 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-21T13:20:27.676 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: cephadm 2024-03-21T13:20:26.025021+0000 mgr.smithi005.rupoiq (mgr.14195) 3 : cephadm [INF] [21/Mar/2024:13:20:26] ENGINE Bus STARTING 2024-03-21T13:20:27.676 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: cephadm 2024-03-21T13:20:26.127079+0000 mgr.smithi005.rupoiq (mgr.14195) 4 : cephadm [INF] [21/Mar/2024:13:20:26] ENGINE Serving on http://172.21.15.5:8765 2024-03-21T13:20:27.677 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: cephadm 2024-03-21T13:20:26.252449+0000 mgr.smithi005.rupoiq (mgr.14195) 5 : cephadm [INF] [21/Mar/2024:13:20:26] ENGINE Serving on https://172.21.15.5:7150 2024-03-21T13:20:27.677 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: cephadm 2024-03-21T13:20:26.252719+0000 mgr.smithi005.rupoiq (mgr.14195) 6 : cephadm [INF] [21/Mar/2024:13:20:26] ENGINE Bus STARTED 2024-03-21T13:20:27.677 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: cluster 2024-03-21T13:20:26.473131+0000 mon.smithi005 (mon.0) 176 : cluster [DBG] mgrmap e17: smithi005.rupoiq(active, since 2s) 2024-03-21T13:20:27.677 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:27 smithi005 bash[18615]: audit 2024-03-21T13:20:27.094244+0000 mon.smithi005 (mon.0) 177 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:28.338 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-21T13:20:29.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:29 smithi005 bash[18615]: audit 2024-03-21T13:20:28.242694+0000 mon.smithi005 (mon.0) 178 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:31.419 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-21T13:20:31.419 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","modified":"2024-03-21T13:17:43.965836Z","created":"2024-03-21T13:17:43.965836Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-21T13:20:31.422 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-03-21T13:20:32.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:31 smithi005 bash[18615]: audit 2024-03-21T13:20:30.742460+0000 mon.smithi005 (mon.0) 179 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:32.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:31 smithi005 bash[18615]: audit 2024-03-21T13:20:30.745852+0000 mon.smithi005 (mon.0) 180 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:32.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:31 smithi005 bash[18615]: audit 2024-03-21T13:20:31.419358+0000 mon.smithi005 (mon.0) 181 : audit [DBG] from='client.? 172.21.15.157:0/4095561955' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-21T13:20:33.281 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-21T13:20:33.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-21T13:20:33.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:32 smithi005 bash[18615]: audit 2024-03-21T13:20:31.841221+0000 mon.smithi005 (mon.0) 182 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:33.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:32 smithi005 bash[18615]: audit 2024-03-21T13:20:31.849994+0000 mon.smithi005 (mon.0) 183 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:33.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:32 smithi005 bash[18615]: audit 2024-03-21T13:20:31.852464+0000 mon.smithi005 (mon.0) 184 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:20:35.448 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.589061+0000 mon.smithi005 (mon.0) 185 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.594981+0000 mon.smithi005 (mon.0) 186 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.603201+0000 mon.smithi005 (mon.0) 187 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.609353+0000 mon.smithi005 (mon.0) 188 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.611150+0000 mon.smithi005 (mon.0) 189 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.613397+0000 mon.smithi005 (mon.0) 190 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:36.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:34.615240+0000 mon.smithi005 (mon.0) 191 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: cephadm 2024-03-21T13:20:34.617883+0000 mgr.smithi005.rupoiq (mgr.14195) 7 : cephadm [INF] Updating smithi005:/etc/ceph/ceph.conf 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: cephadm 2024-03-21T13:20:34.618398+0000 mgr.smithi005.rupoiq (mgr.14195) 8 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: cephadm 2024-03-21T13:20:34.884323+0000 mgr.smithi005.rupoiq (mgr.14195) 9 : cephadm [INF] Updating smithi005:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: cephadm 2024-03-21T13:20:34.885710+0000 mgr.smithi005.rupoiq (mgr.14195) 10 : cephadm [INF] Updating smithi157:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.384049+0000 mon.smithi005 (mon.0) 192 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.388446+0000 mon.smithi005 (mon.0) 193 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.392871+0000 mon.smithi005 (mon.0) 194 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.395651+0000 mon.smithi005 (mon.0) 195 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.399518+0000 mon.smithi005 (mon.0) 196 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.401986+0000 mon.smithi005 (mon.0) 197 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi157", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.403312+0000 mon.smithi005 (mon.0) 198 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi157", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-03-21T13:20:36.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:35 smithi005 bash[18615]: audit 2024-03-21T13:20:35.406876+0000 mon.smithi005 (mon.0) 199 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:37.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:36 smithi005 bash[18615]: cephadm 2024-03-21T13:20:35.049104+0000 mgr.smithi005.rupoiq (mgr.14195) 11 : cephadm [INF] Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-03-21T13:20:37.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:36 smithi005 bash[18615]: cephadm 2024-03-21T13:20:35.050866+0000 mgr.smithi005.rupoiq (mgr.14195) 12 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-03-21T13:20:37.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:36 smithi005 bash[18615]: cephadm 2024-03-21T13:20:35.213887+0000 mgr.smithi005.rupoiq (mgr.14195) 13 : cephadm [INF] Updating smithi005:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-21T13:20:37.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:36 smithi005 bash[18615]: cephadm 2024-03-21T13:20:35.215231+0000 mgr.smithi005.rupoiq (mgr.14195) 14 : cephadm [INF] Updating smithi157:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.client.admin.keyring 2024-03-21T13:20:37.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:36 smithi005 bash[18615]: cephadm 2024-03-21T13:20:35.408426+0000 mgr.smithi005.rupoiq (mgr.14195) 15 : cephadm [INF] Deploying daemon ceph-exporter.smithi157 on smithi157 2024-03-21T13:20:38.790 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-21T13:20:38.790 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","modified":"2024-03-21T13:17:43.965836Z","created":"2024-03-21T13:17:43.965836Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-21T13:20:38.792 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-03-21T13:20:39.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:38 smithi005 bash[18615]: audit 2024-03-21T13:20:38.790624+0000 mon.smithi005 (mon.0) 200 : audit [DBG] from='client.? 172.21.15.157:0/2680954495' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.853531+0000 mon.smithi005 (mon.0) 201 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.859779+0000 mon.smithi005 (mon.0) 202 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.886327+0000 mon.smithi005 (mon.0) 203 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.892273+0000 mon.smithi005 (mon.0) 204 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.895623+0000 mon.smithi005 (mon.0) 205 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.897529+0000 mon.smithi005 (mon.0) 206 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:38.902097+0000 mon.smithi005 (mon.0) 207 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: cephadm 2024-03-21T13:20:38.904434+0000 mgr.smithi005.rupoiq (mgr.14195) 16 : cephadm [INF] Deploying daemon crash.smithi157 on smithi157 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:39.495154+0000 mon.smithi005 (mon.0) 208 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:40.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:39 smithi005 bash[18615]: audit 2024-03-21T13:20:39.495796+0000 mon.smithi005 (mon.0) 209 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:20:41.026 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-21T13:20:41.027 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-21T13:20:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:42 smithi005 bash[18615]: audit 2024-03-21T13:20:41.716887+0000 mon.smithi005 (mon.0) 210 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:42 smithi005 bash[18615]: audit 2024-03-21T13:20:41.723190+0000 mon.smithi005 (mon.0) 211 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:42 smithi005 bash[18615]: audit 2024-03-21T13:20:41.730167+0000 mon.smithi005 (mon.0) 212 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:42 smithi005 bash[18615]: audit 2024-03-21T13:20:41.735698+0000 mon.smithi005 (mon.0) 213 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:43.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:42 smithi005 bash[18615]: cephadm 2024-03-21T13:20:41.739122+0000 mgr.smithi005.rupoiq (mgr.14195) 17 : cephadm [INF] Deploying daemon node-exporter.smithi157 on smithi157 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.870641+0000 mon.smithi005 (mon.0) 214 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.877510+0000 mon.smithi005 (mon.0) 215 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.914748+0000 mon.smithi005 (mon.0) 216 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.920764+0000 mon.smithi005 (mon.0) 217 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.925867+0000 mon.smithi005 (mon.0) 218 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.xdzklg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.927852+0000 mon.smithi005 (mon.0) 219 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.xdzklg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.932545+0000 mon.smithi005 (mon.0) 220 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: audit 2024-03-21T13:20:42.934659+0000 mon.smithi005 (mon.0) 221 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:44.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:43 smithi005 bash[18615]: cephadm 2024-03-21T13:20:42.936852+0000 mgr.smithi005.rupoiq (mgr.14195) 18 : cephadm [INF] Deploying daemon mgr.smithi157.xdzklg on smithi157 2024-03-21T13:20:44.723 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:20:45.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:45 smithi005 bash[18615]: cluster 2024-03-21T13:20:44.423030+0000 mgr.smithi005.rupoiq (mgr.14195) 19 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:45.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:45 smithi005 bash[18615]: audit 2024-03-21T13:20:44.502104+0000 mon.smithi005 (mon.0) 222 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:47.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:47 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: cluster 2024-03-21T13:20:46.423443+0000 mgr.smithi005.rupoiq (mgr.14195) 20 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.765092+0000 mon.smithi005 (mon.0) 223 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.771904+0000 mon.smithi005 (mon.0) 224 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.816868+0000 mon.smithi005 (mon.0) 225 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.822690+0000 mon.smithi005 (mon.0) 226 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.826439+0000 mon.smithi005 (mon.0) 227 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: audit 2024-03-21T13:20:46.828181+0000 mon.smithi005 (mon.0) 228 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:48.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:47 smithi005 bash[18615]: cephadm 2024-03-21T13:20:46.830263+0000 mgr.smithi005.rupoiq (mgr.14195) 21 : cephadm [INF] Deploying daemon mon.smithi157 on smithi157 2024-03-21T13:20:50.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:49 smithi005 bash[18615]: cluster 2024-03-21T13:20:48.423955+0000 mgr.smithi005.rupoiq (mgr.14195) 22 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:50.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:49 smithi005 bash[18615]: audit 2024-03-21T13:20:49.509269+0000 mon.smithi005 (mon.0) 229 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:50.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-21T13:20:50.409 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","modified":"2024-03-21T13:17:43.965836Z","created":"2024-03-21T13:17:43.965836Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-21T13:20:50.412 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-03-21T13:20:51.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:50 smithi005 bash[18615]: audit 2024-03-21T13:20:50.409344+0000 mon.smithi005 (mon.0) 230 : audit [DBG] from='client.? 172.21.15.157:0/2780640349' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-21T13:20:52.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:51 smithi005 bash[18615]: cluster 2024-03-21T13:20:50.424444+0000 mgr.smithi005.rupoiq (mgr.14195) 23 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:52.548 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-21T13:20:52.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph mon dump -f json 2024-03-21T13:20:53.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:52 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:53.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:52 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:53.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:52 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:53 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:20:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:53 smithi157 systemd[1]: Started Ceph mon.smithi157 for 3164d712-e785-11ee-95cd-87774f69a715. 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: cluster 2024-03-21T13:20:52.424912+0000 mgr.smithi005.rupoiq (mgr.14195) 24 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.206328+0000 mon.smithi005 (mon.0) 231 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.213248+0000 mon.smithi005 (mon.0) 232 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.266376+0000 mon.smithi005 (mon.0) 233 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.272360+0000 mon.smithi005 (mon.0) 234 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.282350+0000 mon.smithi005 (mon.0) 235 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:53 smithi005 bash[18615]: audit 2024-03-21T13:20:53.349125+0000 mon.smithi005 (mon.0) 236 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:20:54.201 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.183+0000 7f6feff24c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.183+0000 7f6feff24c80 0 ceph version 19.0.0-2267-g960fbbe4 (960fbbe4645c2becc8084669be194c95183c7753) squid (dev), process ceph-mon, pid 7 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.183+0000 7f6feff24c80 0 pidfile_write: ignore empty --pid-file 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 0 load: jerasure load: lrc 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: RocksDB version: 7.9.2 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Git sha 0 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Compile date 2024-03-21 08:53:26 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: DB SUMMARY 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: DB Session ID: BCAM0GNZWOAYD1WXTVW8 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: CURRENT file: CURRENT 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: IDENTITY file: IDENTITY 2024-03-21T13:20:54.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi157/store.db dir, Total Num: 0, files: 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi157/store.db: 000004.log size: 511 ; 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.error_if_exists: 0 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.create_if_missing: 0 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.paranoid_checks: 1 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.env: 0x55d0f6958b20 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.fs: PosixFileSystem 2024-03-21T13:20:54.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.info_log: 0x55d0f7263800 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.statistics: (nil) 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.use_fsync: 0 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_log_file_size: 0 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_fallocate: 1 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-21T13:20:54.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.use_direct_reads: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.create_missing_column_families: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.db_log_dir: 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.wal_dir: 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.advise_random_on_open: 1 2024-03-21T13:20:54.205 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.write_buffer_manager: 0x55d0f72341e0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.rate_limiter: (nil) 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.unordered_write: 0 2024-03-21T13:20:54.206 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.row_cache: None 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.wal_filter: None 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.two_write_queues: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.manual_wal_flush: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.wal_compression: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.atomic_flush: 0 2024-03-21T13:20:54.207 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.log_readahead_size: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_background_jobs: 2 2024-03-21T13:20:54.208 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_background_compactions: -1 2024-03-21T13:20:54.209 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_subcompactions: 1 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_total_wal_size: 0 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-21T13:20:54.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_open_files: -1 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bytes_per_sync: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_background_flushes: -1 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Compression algorithms supported: 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kZSTD supported: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kXpressCompression supported: 0 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kZlibCompression supported: 1 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kSnappyCompression supported: 1 2024-03-21T13:20:54.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kLZ4Compression supported: 1 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: kBZip2Compression supported: 0 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000005 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.merge_operator: 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_filter: None 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_filter_factory: None 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-21T13:20:54.212 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d0f7263920) 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: cache_index_and_filter_blocks: 1 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: pin_top_level_index_and_filter: 1 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: index_type: 0 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: data_block_index_type: 0 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: index_shortening: 1 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: data_block_hash_table_util_ratio: 0.750000 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: checksum: 4 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: no_block_cache: 0 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_cache: 0x55d0f7265090 2024-03-21T13:20:54.213 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_cache_name: BinnedLRUCache 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_cache_options: 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: capacity : 536870912 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: num_shard_bits : 4 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: strict_capacity_limit : 0 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: high_pri_pool_ratio: 0.000 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_cache_compressed: (nil) 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: persistent_cache: (nil) 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_size: 4096 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_size_deviation: 10 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_restart_interval: 16 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: index_block_restart_interval: 1 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: metadata_block_size: 4096 2024-03-21T13:20:54.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: partition_filters: 0 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: use_delta_encoding: 1 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: filter_policy: bloomfilter 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: whole_key_filtering: 1 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: verify_compression: 0 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: read_amp_bytes_per_bit: 0 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: format_version: 5 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: enable_index_compression: 1 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: block_align: 0 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: max_auto_readahead_size: 262144 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: prepopulate_block_cache: 0 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: initial_auto_readahead_size: 8192 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: num_file_reads_for_auto_readahead: 2 2024-03-21T13:20:54.215 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression: NoCompression 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.num_levels: 7 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-21T13:20:54.216 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.level: 32767 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-21T13:20:54.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.enabled: false 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-21T13:20:54.218 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.arena_block_size: 1048576 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-21T13:20:54.219 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.table_properties_collectors: 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.inplace_update_support: 0 2024-03-21T13:20:54.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.bloom_locality: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.max_successive_merges: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.force_consistency_checks: 1 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.ttl: 2592000 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-21T13:20:54.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enable_blob_files: false 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.min_blob_size: 0 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_file_size: 268435456 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-21T13:20:54.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-21T13:20:54.223 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92d1191e-e829-4d05-9e0c-e0acd0c394ac 2024-03-21T13:20:54.223 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027254193499, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-21T13:20:54.223 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-21T13:20:54.223 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027254193975, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711027254, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92d1191e-e829-4d05-9e0c-e0acd0c394ac", "db_session_id": "BCAM0GNZWOAYD1WXTVW8", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-21T13:20:54.223 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1711027254194079, "job": 1, "event": "recovery_finished"} 2024-03-21T13:20:54.442 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.187+0000 7f6feff24c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-21T13:20:54.442 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi157/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-21T13:20:54.442 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d0f7356000 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 4 rocksdb: DB pointer 0x55d0f7342000 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6fde680700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6fde680700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: ** DB Stats ** 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: ** Compaction Stats [default] ** 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:20:54.443 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: ** Compaction Stats [default] ** 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-21T13:20:54.444 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: AddFile(Total Files): cumulative 0, interval 0 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: AddFile(Keys): cumulative 0, interval 0 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Cumulative compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Interval compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Block cache BinnedLRUCache@0x55d0f7265090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.9e-05 secs_since: 0 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: ** File Read Latency Histogram By Level [default] ** 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 0 mon.smithi157 does not exist in monmap, will attempt to join an existing cluster 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 0 using public_addr v2:172.21.15.157:0/0 -> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 0 starting mon.smithi157 rank -1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi157 fsid 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.191+0000 7f6feff24c80 1 mon.smithi157@-1(???) e0 preinit fsid 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:20:54.445 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).mds e1 new map 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).mds e1 print_map 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: e1 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: legacy client fscid: -1 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: No filesystems configured 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-03-21T13:20:54.446 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 0 mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: cluster 2024-03-21T13:20:52.424912+0000 mgr.smithi005.rupoiq (mgr.14195) 24 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.206328+0000 mon.smithi005 (mon.0) 231 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.213248+0000 mon.smithi005 (mon.0) 232 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.266376+0000 mon.smithi005 (mon.0) 233 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.272360+0000 mon.smithi005 (mon.0) 234 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.282350+0000 mon.smithi005 (mon.0) 235 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: audit 2024-03-21T13:20:53.349125+0000 mon.smithi005 (mon.0) 236 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:20:54.447 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:54 smithi157 bash[23502]: debug 2024-03-21T13:20:54.219+0000 7f6fe1686700 1 mon.smithi157@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-03-21T13:20:58.282 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi157/config 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:54.231355+0000 mon.smithi005 (mon.0) 237 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:54.236463+0000 mon.smithi005 (mon.0) 238 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:54.236766+0000 mon.smithi005 (mon.0) 239 : cluster [INF] mon.smithi005 calling monitor election 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:54.256999+0000 mon.smithi005 (mon.0) 240 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:54.425325+0000 mgr.smithi005.rupoiq (mgr.14195) 25 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:54.495366+0000 mon.smithi005 (mon.0) 241 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:55.231236+0000 mon.smithi005 (mon.0) 242 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:56.231630+0000 mon.smithi005 (mon.0) 243 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:56.232672+0000 mon.smithi157 (mon.1) 1 : cluster [INF] mon.smithi157 calling monitor election 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:56.425730+0000 mgr.smithi005.rupoiq (mgr.14195) 26 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:57.231453+0000 mon.smithi005 (mon.0) 244 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:58.229123+0000 mon.smithi005 (mon.0) 245 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.xdzklg/crt"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:58.231330+0000 mon.smithi005 (mon.0) 246 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:58.426106+0000 mgr.smithi005.rupoiq (mgr.14195) 27 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.231643+0000 mon.smithi005 (mon.0) 247 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.277373+0000 mon.smithi005 (mon.0) 248 : cluster [INF] mon.smithi005 is new leader, mons smithi005,smithi157 in quorum (ranks 0,1) 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.282857+0000 mon.smithi005 (mon.0) 249 : cluster [DBG] monmap e2: 2 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-21T13:20:59.544 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.300621+0000 mon.smithi005 (mon.0) 250 : cluster [DBG] fsmap 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.300712+0000 mon.smithi005 (mon.0) 251 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.300997+0000 mon.smithi005 (mon.0) 252 : cluster [DBG] mgrmap e17: smithi005.rupoiq(active, since 34s) 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.301261+0000 mon.smithi005 (mon.0) 253 : cluster [INF] overall HEALTH_OK 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.304411+0000 mon.smithi005 (mon.0) 254 : cluster [DBG] Standby manager daemon smithi157.xdzklg started 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.310833+0000 mon.smithi005 (mon.0) 255 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.313053+0000 mon.smithi005 (mon.0) 256 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.317529+0000 mon.smithi005 (mon.0) 257 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.318359+0000 mon.smithi005 (mon.0) 258 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.xdzklg/key"}]: dispatch 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.319197+0000 mon.smithi005 (mon.0) 259 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.332168+0000 mon.smithi005 (mon.0) 260 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.334457+0000 mon.smithi005 (mon.0) 261 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:59.545 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:20:59 smithi157 bash[23502]: audit 2024-03-21T13:20:59.336340+0000 mon.smithi005 (mon.0) 262 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:54.231355+0000 mon.smithi005 (mon.0) 237 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:54.236463+0000 mon.smithi005 (mon.0) 238 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:54.236766+0000 mon.smithi005 (mon.0) 239 : cluster [INF] mon.smithi005 calling monitor election 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:54.256999+0000 mon.smithi005 (mon.0) 240 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:54.425325+0000 mgr.smithi005.rupoiq (mgr.14195) 25 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:54.495366+0000 mon.smithi005 (mon.0) 241 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:55.231236+0000 mon.smithi005 (mon.0) 242 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:56.231630+0000 mon.smithi005 (mon.0) 243 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:56.232672+0000 mon.smithi157 (mon.1) 1 : cluster [INF] mon.smithi157 calling monitor election 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:56.425730+0000 mgr.smithi005.rupoiq (mgr.14195) 26 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:57.231453+0000 mon.smithi005 (mon.0) 244 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:58.229123+0000 mon.smithi005 (mon.0) 245 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.xdzklg/crt"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:58.231330+0000 mon.smithi005 (mon.0) 246 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:58.426106+0000 mgr.smithi005.rupoiq (mgr.14195) 27 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.231643+0000 mon.smithi005 (mon.0) 247 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.277373+0000 mon.smithi005 (mon.0) 248 : cluster [INF] mon.smithi005 is new leader, mons smithi005,smithi157 in quorum (ranks 0,1) 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.282857+0000 mon.smithi005 (mon.0) 249 : cluster [DBG] monmap e2: 2 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.300621+0000 mon.smithi005 (mon.0) 250 : cluster [DBG] fsmap 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.300712+0000 mon.smithi005 (mon.0) 251 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-21T13:20:59.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.300997+0000 mon.smithi005 (mon.0) 252 : cluster [DBG] mgrmap e17: smithi005.rupoiq(active, since 34s) 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.301261+0000 mon.smithi005 (mon.0) 253 : cluster [INF] overall HEALTH_OK 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.304411+0000 mon.smithi005 (mon.0) 254 : cluster [DBG] Standby manager daemon smithi157.xdzklg started 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.310833+0000 mon.smithi005 (mon.0) 255 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.313053+0000 mon.smithi005 (mon.0) 256 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.317529+0000 mon.smithi005 (mon.0) 257 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.318359+0000 mon.smithi005 (mon.0) 258 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.xdzklg/key"}]: dispatch 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.319197+0000 mon.smithi005 (mon.0) 259 : audit [DBG] from='mgr.? 172.21.15.157:0/3962773566' entity='mgr.smithi157.xdzklg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.332168+0000 mon.smithi005 (mon.0) 260 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.334457+0000 mon.smithi005 (mon.0) 261 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:20:59.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:20:59 smithi005 bash[18615]: audit 2024-03-21T13:20:59.336340+0000 mon.smithi005 (mon.0) 262 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:21:00.683 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.338991+0000 mgr.smithi005.rupoiq (mgr.14195) 28 : cephadm [INF] Updating smithi005:/etc/ceph/ceph.conf 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.339561+0000 mgr.smithi005.rupoiq (mgr.14195) 29 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cluster 2024-03-21T13:20:59.386897+0000 mon.smithi005 (mon.0) 263 : cluster [DBG] mgrmap e18: smithi005.rupoiq(active, since 34s), standbys: smithi157.xdzklg 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.387190+0000 mon.smithi005 (mon.0) 264 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi157.xdzklg", "id": "smithi157.xdzklg"}]: dispatch 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.606653+0000 mgr.smithi005.rupoiq (mgr.14195) 30 : cephadm [INF] Updating smithi005:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.606846+0000 mgr.smithi005.rupoiq (mgr.14195) 31 : cephadm [INF] Updating smithi157:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.779444+0000 mon.smithi005 (mon.0) 265 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.787456+0000 mon.smithi005 (mon.0) 266 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.829995+0000 mon.smithi005 (mon.0) 267 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.838475+0000 mon.smithi005 (mon.0) 268 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.846300+0000 mon.smithi005 (mon.0) 269 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.920693+0000 mgr.smithi005.rupoiq (mgr.14195) 32 : cephadm [INF] Reconfiguring mon.smithi005 (unknown last config time)... 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.921502+0000 mon.smithi005 (mon.0) 270 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-21T13:21:00.684 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.923381+0000 mon.smithi005 (mon.0) 271 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-21T13:21:00.685 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:20:59.925199+0000 mon.smithi005 (mon.0) 272 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:00.685 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: cephadm 2024-03-21T13:20:59.927298+0000 mgr.smithi005.rupoiq (mgr.14195) 33 : cephadm [INF] Reconfiguring daemon mon.smithi005 on smithi005 2024-03-21T13:21:00.685 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:00 smithi005 bash[18615]: audit 2024-03-21T13:21:00.231674+0000 mon.smithi005 (mon.0) 273 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:21:00.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.338991+0000 mgr.smithi005.rupoiq (mgr.14195) 28 : cephadm [INF] Updating smithi005:/etc/ceph/ceph.conf 2024-03-21T13:21:00.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.339561+0000 mgr.smithi005.rupoiq (mgr.14195) 29 : cephadm [INF] Updating smithi157:/etc/ceph/ceph.conf 2024-03-21T13:21:00.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cluster 2024-03-21T13:20:59.386897+0000 mon.smithi005 (mon.0) 263 : cluster [DBG] mgrmap e18: smithi005.rupoiq(active, since 34s), standbys: smithi157.xdzklg 2024-03-21T13:21:00.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.387190+0000 mon.smithi005 (mon.0) 264 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr metadata", "who": "smithi157.xdzklg", "id": "smithi157.xdzklg"}]: dispatch 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.606653+0000 mgr.smithi005.rupoiq (mgr.14195) 30 : cephadm [INF] Updating smithi005:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.606846+0000 mgr.smithi005.rupoiq (mgr.14195) 31 : cephadm [INF] Updating smithi157:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/config/ceph.conf 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.779444+0000 mon.smithi005 (mon.0) 265 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.787456+0000 mon.smithi005 (mon.0) 266 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.829995+0000 mon.smithi005 (mon.0) 267 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.838475+0000 mon.smithi005 (mon.0) 268 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.846300+0000 mon.smithi005 (mon.0) 269 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.920693+0000 mgr.smithi005.rupoiq (mgr.14195) 32 : cephadm [INF] Reconfiguring mon.smithi005 (unknown last config time)... 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.921502+0000 mon.smithi005 (mon.0) 270 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.923381+0000 mon.smithi005 (mon.0) 271 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:20:59.925199+0000 mon.smithi005 (mon.0) 272 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: cephadm 2024-03-21T13:20:59.927298+0000 mgr.smithi005.rupoiq (mgr.14195) 33 : cephadm [INF] Reconfiguring daemon mon.smithi005 on smithi005 2024-03-21T13:21:00.794 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:00 smithi157 bash[23502]: audit 2024-03-21T13:21:00.231674+0000 mon.smithi005 (mon.0) 273 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:21:01.341 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-21T13:21:01.341 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":2,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","modified":"2024-03-21T13:20:54.230756Z","created":"2024-03-21T13:17:43.965836Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-21T13:21:01.344 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 2 2024-03-21T13:21:01.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:01 smithi005 bash[18615]: cluster 2024-03-21T13:21:00.426472+0000 mgr.smithi005.rupoiq (mgr.14195) 34 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:01.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:01 smithi005 bash[18615]: audit 2024-03-21T13:21:01.342105+0000 mon.smithi005 (mon.0) 274 : audit [DBG] from='client.? 172.21.15.157:0/1583588797' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-21T13:21:01.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:01 smithi157 bash[23502]: cluster 2024-03-21T13:21:00.426472+0000 mgr.smithi005.rupoiq (mgr.14195) 34 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:01.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:01 smithi157 bash[23502]: audit 2024-03-21T13:21:01.342105+0000 mon.smithi005 (mon.0) 274 : audit [DBG] from='client.? 172.21.15.157:0/1583588797' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-21T13:21:02.067 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-21T13:21:02.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph config generate-minimal-conf 2024-03-21T13:21:03.289 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: audit 2024-03-21T13:21:02.005778+0000 mon.smithi005 (mon.0) 275 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:03.289 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: audit 2024-03-21T13:21:02.014377+0000 mon.smithi005 (mon.0) 276 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: cephadm 2024-03-21T13:21:02.049186+0000 mgr.smithi005.rupoiq (mgr.14195) 35 : cephadm [INF] Reconfiguring mgr.smithi005.rupoiq (unknown last config time)... 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: audit 2024-03-21T13:21:02.049873+0000 mon.smithi005 (mon.0) 277 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.rupoiq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: audit 2024-03-21T13:21:02.051943+0000 mon.smithi005 (mon.0) 278 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: audit 2024-03-21T13:21:02.053563+0000 mon.smithi005 (mon.0) 279 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: cephadm 2024-03-21T13:21:02.055614+0000 mgr.smithi005.rupoiq (mgr.14195) 36 : cephadm [INF] Reconfiguring daemon mgr.smithi005.rupoiq on smithi005 2024-03-21T13:21:03.290 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:03 smithi005 bash[18615]: cluster 2024-03-21T13:21:02.426882+0000 mgr.smithi005.rupoiq (mgr.14195) 37 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: audit 2024-03-21T13:21:02.005778+0000 mon.smithi005 (mon.0) 275 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: audit 2024-03-21T13:21:02.014377+0000 mon.smithi005 (mon.0) 276 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: cephadm 2024-03-21T13:21:02.049186+0000 mgr.smithi005.rupoiq (mgr.14195) 35 : cephadm [INF] Reconfiguring mgr.smithi005.rupoiq (unknown last config time)... 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: audit 2024-03-21T13:21:02.049873+0000 mon.smithi005 (mon.0) 277 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.rupoiq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: audit 2024-03-21T13:21:02.051943+0000 mon.smithi005 (mon.0) 278 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: audit 2024-03-21T13:21:02.053563+0000 mon.smithi005 (mon.0) 279 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: cephadm 2024-03-21T13:21:02.055614+0000 mgr.smithi005.rupoiq (mgr.14195) 36 : cephadm [INF] Reconfiguring daemon mgr.smithi005.rupoiq on smithi005 2024-03-21T13:21:03.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:03 smithi157 bash[23502]: cluster 2024-03-21T13:21:02.426882+0000 mgr.smithi005.rupoiq (mgr.14195) 37 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:05.391 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: audit 2024-03-21T13:21:04.114654+0000 mon.smithi005 (mon.0) 280 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:05.391 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: audit 2024-03-21T13:21:04.121753+0000 mon.smithi005 (mon.0) 281 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:05.391 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: cephadm 2024-03-21T13:21:04.125105+0000 mgr.smithi005.rupoiq (mgr.14195) 38 : cephadm [INF] Reconfiguring ceph-exporter.smithi005 (monmap changed)... 2024-03-21T13:21:05.392 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: audit 2024-03-21T13:21:04.125746+0000 mon.smithi005 (mon.0) 282 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi005", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:21:05.392 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: audit 2024-03-21T13:21:04.127377+0000 mon.smithi005 (mon.0) 283 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:05.392 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: cephadm 2024-03-21T13:21:04.129170+0000 mgr.smithi005.rupoiq (mgr.14195) 39 : cephadm [INF] Reconfiguring daemon ceph-exporter.smithi005 on smithi005 2024-03-21T13:21:05.392 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:05 smithi005 bash[18615]: cluster 2024-03-21T13:21:04.427185+0000 mgr.smithi005.rupoiq (mgr.14195) 40 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: audit 2024-03-21T13:21:04.114654+0000 mon.smithi005 (mon.0) 280 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: audit 2024-03-21T13:21:04.121753+0000 mon.smithi005 (mon.0) 281 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: cephadm 2024-03-21T13:21:04.125105+0000 mgr.smithi005.rupoiq (mgr.14195) 38 : cephadm [INF] Reconfiguring ceph-exporter.smithi005 (monmap changed)... 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: audit 2024-03-21T13:21:04.125746+0000 mon.smithi005 (mon.0) 282 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi005", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: audit 2024-03-21T13:21:04.127377+0000 mon.smithi005 (mon.0) 283 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: cephadm 2024-03-21T13:21:04.129170+0000 mgr.smithi005.rupoiq (mgr.14195) 39 : cephadm [INF] Reconfiguring daemon ceph-exporter.smithi005 on smithi005 2024-03-21T13:21:05.422 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:05 smithi157 bash[23502]: cluster 2024-03-21T13:21:04.427185+0000 mgr.smithi005.rupoiq (mgr.14195) 40 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:06.830 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:21:07.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:06 smithi157 bash[23502]: audit 2024-03-21T13:21:05.967677+0000 mon.smithi005 (mon.0) 284 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:07.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:06 smithi157 bash[23502]: audit 2024-03-21T13:21:05.978105+0000 mon.smithi005 (mon.0) 285 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:07.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:06 smithi157 bash[23502]: audit 2024-03-21T13:21:05.998299+0000 mon.smithi005 (mon.0) 286 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:21:07.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:06 smithi157 bash[23502]: audit 2024-03-21T13:21:05.999960+0000 mon.smithi005 (mon.0) 287 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:07.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:06 smithi005 bash[18615]: audit 2024-03-21T13:21:05.967677+0000 mon.smithi005 (mon.0) 284 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:07.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:06 smithi005 bash[18615]: audit 2024-03-21T13:21:05.978105+0000 mon.smithi005 (mon.0) 285 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:07.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:06 smithi005 bash[18615]: audit 2024-03-21T13:21:05.998299+0000 mon.smithi005 (mon.0) 286 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:21:07.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:06 smithi005 bash[18615]: audit 2024-03-21T13:21:05.999960+0000 mon.smithi005 (mon.0) 287 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:08.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:07 smithi157 bash[23502]: cephadm 2024-03-21T13:21:05.997584+0000 mgr.smithi005.rupoiq (mgr.14195) 41 : cephadm [INF] Reconfiguring crash.smithi005 (monmap changed)... 2024-03-21T13:21:08.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:07 smithi157 bash[23502]: cephadm 2024-03-21T13:21:06.001580+0000 mgr.smithi005.rupoiq (mgr.14195) 42 : cephadm [INF] Reconfiguring daemon crash.smithi005 on smithi005 2024-03-21T13:21:08.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:07 smithi157 bash[23502]: cluster 2024-03-21T13:21:06.427507+0000 mgr.smithi005.rupoiq (mgr.14195) 43 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:08.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:07 smithi005 bash[18615]: cephadm 2024-03-21T13:21:05.997584+0000 mgr.smithi005.rupoiq (mgr.14195) 41 : cephadm [INF] Reconfiguring crash.smithi005 (monmap changed)... 2024-03-21T13:21:08.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:07 smithi005 bash[18615]: cephadm 2024-03-21T13:21:06.001580+0000 mgr.smithi005.rupoiq (mgr.14195) 42 : cephadm [INF] Reconfiguring daemon crash.smithi005 on smithi005 2024-03-21T13:21:08.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:07 smithi005 bash[18615]: cluster 2024-03-21T13:21:06.427507+0000 mgr.smithi005.rupoiq (mgr.14195) 43 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: cluster 2024-03-21T13:21:08.427971+0000 mgr.smithi005.rupoiq (mgr.14195) 44 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: audit 2024-03-21T13:21:08.830924+0000 mon.smithi005 (mon.0) 288 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: audit 2024-03-21T13:21:08.838567+0000 mon.smithi005 (mon.0) 289 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: cephadm 2024-03-21T13:21:08.875897+0000 mgr.smithi005.rupoiq (mgr.14195) 45 : cephadm [INF] Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: cephadm 2024-03-21T13:21:08.896146+0000 mgr.smithi005.rupoiq (mgr.14195) 46 : cephadm [INF] Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-03-21T13:21:10.091 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:09 smithi005 bash[18615]: audit 2024-03-21T13:21:09.495953+0000 mon.smithi005 (mon.0) 290 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: cluster 2024-03-21T13:21:08.427971+0000 mgr.smithi005.rupoiq (mgr.14195) 44 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: audit 2024-03-21T13:21:08.830924+0000 mon.smithi005 (mon.0) 288 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: audit 2024-03-21T13:21:08.838567+0000 mon.smithi005 (mon.0) 289 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: cephadm 2024-03-21T13:21:08.875897+0000 mgr.smithi005.rupoiq (mgr.14195) 45 : cephadm [INF] Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: cephadm 2024-03-21T13:21:08.896146+0000 mgr.smithi005.rupoiq (mgr.14195) 46 : cephadm [INF] Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-03-21T13:21:10.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:09 smithi157 bash[23502]: audit 2024-03-21T13:21:09.495953+0000 mon.smithi005 (mon.0) 290 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:10.489 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:21:10.489 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-03-21T13:21:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:21:10.489 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-03-21T13:21:11.017 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:10 smithi005 bash[18615]: audit 2024-03-21T13:21:10.490250+0000 mon.smithi005 (mon.0) 291 : audit [DBG] from='client.? 172.21.15.5:0/1222827343' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:11.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:10 smithi157 bash[23502]: audit 2024-03-21T13:21:10.490250+0000 mon.smithi005 (mon.0) 291 : audit [DBG] from='client.? 172.21.15.5:0/1222827343' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:11.678 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-21T13:21:11.678 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:21:11.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-03-21T13:21:11.693 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:21:11.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-21T13:21:11.751 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:21:11.751 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-03-21T13:21:11.765 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:21:11.766 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-21T13:21:11.822 INFO:tasks.cephadm:Deploying OSDs... 2024-03-21T13:21:11.822 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:21:11.822 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:21:11.828 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-03-21T13:21:11.828 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/nvme1n1 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/nvme1n1 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 969 Links: 1 Device type: 103,2 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:19:20.479796043 +0000 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:16:12.203916360 +0000 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:16:12.203916360 +0000 2024-03-21T13:21:11.876 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:21:11.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-03-21T13:21:11.928 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:11 smithi005 bash[18615]: cluster 2024-03-21T13:21:10.428357+0000 mgr.smithi005.rupoiq (mgr.14195) 47 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:11.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:21:11.930 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:21:11.930 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00040133 s, 1.3 MB/s 2024-03-21T13:21:11.932 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-03-21T13:21:11.980 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/nvme2n1 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/nvme2n1 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 978 Links: 1 Device type: 103,4 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:19:20.495795899 +0000 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:16:12.307863431 +0000 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:16:12.307863431 +0000 2024-03-21T13:21:12.031 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:21:12.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-03-21T13:21:12.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:11 smithi157 bash[23502]: cluster 2024-03-21T13:21:10.428357+0000 mgr.smithi005.rupoiq (mgr.14195) 47 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:21:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:21:12.086 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000384236 s, 1.3 MB/s 2024-03-21T13:21:12.087 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-03-21T13:21:12.136 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/nvme3n1 2024-03-21T13:21:12.182 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/nvme3n1 2024-03-21T13:21:12.182 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.182 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 987 Links: 1 Device type: 103,6 2024-03-21T13:21:12.182 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.182 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:19:20.507795793 +0000 2024-03-21T13:21:12.183 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:16:12.403814574 +0000 2024-03-21T13:21:12.183 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:16:12.403814574 +0000 2024-03-21T13:21:12.183 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:21:12.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-03-21T13:21:12.238 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:21:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:21:12.239 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000196453 s, 2.6 MB/s 2024-03-21T13:21:12.240 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-03-21T13:21:12.287 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/nvme4n1 2024-03-21T13:21:12.334 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/nvme4n1 2024-03-21T13:21:12.334 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 996 Links: 1 Device type: 103,8 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-03-21 13:19:20.523795649 +0000 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-03-21 13:16:12.503763682 +0000 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-03-21 13:16:12.503763682 +0000 2024-03-21T13:21:12.335 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-03-21T13:21:12.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-03-21T13:21:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-03-21T13:21:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-03-21T13:21:12.388 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000203206 s, 2.5 MB/s 2024-03-21T13:21:12.388 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-03-21T13:21:12.440 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:21:12.440 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-03-21T13:21:12.446 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-03-21T13:21:12.446 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/nvme1n1 2024-03-21T13:21:12.494 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/nvme1n1 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 965 Links: 1 Device type: 103,2 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:20:33.272664107 +0000 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:16:13.489119408 +0000 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:16:13.489119408 +0000 2024-03-21T13:21:12.495 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:21:12.495 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-03-21T13:21:12.556 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:21:12.556 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:21:12.556 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00037995 s, 1.3 MB/s 2024-03-21T13:21:12.557 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-03-21T13:21:12.615 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/nvme2n1 2024-03-21T13:21:12.674 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/nvme2n1 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 974 Links: 1 Device type: 103,4 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:20:33.288663692 +0000 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:16:13.585166550 +0000 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:16:13.585166550 +0000 2024-03-21T13:21:12.675 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:21:12.675 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-03-21T13:21:12.731 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:21:12.732 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:21:12.732 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000389168 s, 1.3 MB/s 2024-03-21T13:21:12.733 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-03-21T13:21:12.793 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/nvme3n1 2024-03-21T13:21:12.849 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/nvme3n1 2024-03-21T13:21:12.849 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:12.849 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 983 Links: 1 Device type: 103,6 2024-03-21T13:21:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:20:33.304663278 +0000 2024-03-21T13:21:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:16:13.685215656 +0000 2024-03-21T13:21:12.850 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:16:13.685215656 +0000 2024-03-21T13:21:12.850 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:21:12.850 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-03-21T13:21:12.905 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:21:12.905 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:21:12.905 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000191132 s, 2.7 MB/s 2024-03-21T13:21:12.906 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-03-21T13:21:12.959 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/nvme4n1 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/nvme4n1 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 992 Links: 1 Device type: 103,8 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-21 13:20:33.316662966 +0000 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-21 13:16:13.781262799 +0000 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-21 13:16:13.781262799 +0000 2024-03-21T13:21:13.008 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-03-21T13:21:13.009 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-03-21T13:21:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-21T13:21:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-21T13:21:13.064 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.00024318 s, 2.1 MB/s 2024-03-21T13:21:13.064 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-03-21T13:21:13.114 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch apply osd --all-available-devices 2024-03-21T13:21:13.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:13 smithi005 bash[18615]: cluster 2024-03-21T13:21:12.428782+0000 mgr.smithi005.rupoiq (mgr.14195) 48 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:13.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:13 smithi005 bash[18615]: audit 2024-03-21T13:21:13.741740+0000 mon.smithi005 (mon.0) 292 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:13.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:13 smithi005 bash[18615]: audit 2024-03-21T13:21:13.747083+0000 mon.smithi005 (mon.0) 293 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:13 smithi157 bash[23502]: cluster 2024-03-21T13:21:12.428782+0000 mgr.smithi005.rupoiq (mgr.14195) 48 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:13 smithi157 bash[23502]: audit 2024-03-21T13:21:13.741740+0000 mon.smithi005 (mon.0) 292 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:13 smithi157 bash[23502]: audit 2024-03-21T13:21:13.747083+0000 mon.smithi005 (mon.0) 293 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:15.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:14 smithi157 bash[23502]: cephadm 2024-03-21T13:21:13.774806+0000 mgr.smithi005.rupoiq (mgr.14195) 49 : cephadm [INF] Reconfiguring grafana.smithi005 (dependencies changed)... 2024-03-21T13:21:15.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:14 smithi005 bash[18615]: cephadm 2024-03-21T13:21:13.774806+0000 mgr.smithi005.rupoiq (mgr.14195) 49 : cephadm [INF] Reconfiguring grafana.smithi005 (dependencies changed)... 2024-03-21T13:21:15.959 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:15 smithi005 bash[18615]: cephadm 2024-03-21T13:21:14.084918+0000 mgr.smithi005.rupoiq (mgr.14195) 50 : cephadm [INF] Reconfiguring daemon grafana.smithi005 on smithi005 2024-03-21T13:21:15.959 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:15 smithi005 bash[18615]: cluster 2024-03-21T13:21:14.429159+0000 mgr.smithi005.rupoiq (mgr.14195) 51 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:16.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:15 smithi157 bash[23502]: cephadm 2024-03-21T13:21:14.084918+0000 mgr.smithi005.rupoiq (mgr.14195) 50 : cephadm [INF] Reconfiguring daemon grafana.smithi005 on smithi005 2024-03-21T13:21:16.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:15 smithi157 bash[23502]: cluster 2024-03-21T13:21:14.429159+0000 mgr.smithi005.rupoiq (mgr.14195) 51 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:17.886 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi157/config 2024-03-21T13:21:17.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:17 smithi005 bash[18615]: cluster 2024-03-21T13:21:16.429588+0000 mgr.smithi005.rupoiq (mgr.14195) 52 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:18.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:17 smithi157 bash[23502]: cluster 2024-03-21T13:21:16.429588+0000 mgr.smithi005.rupoiq (mgr.14195) 52 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:19.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:19 smithi005 bash[18615]: cluster 2024-03-21T13:21:18.429934+0000 mgr.smithi005.rupoiq (mgr.14195) 53 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:19.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:19 smithi005 bash[18615]: audit 2024-03-21T13:21:18.572407+0000 mon.smithi005 (mon.0) 294 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:19.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:19 smithi005 bash[18615]: audit 2024-03-21T13:21:18.580351+0000 mon.smithi005 (mon.0) 295 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:19.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:19 smithi005 bash[18615]: cephadm 2024-03-21T13:21:18.627043+0000 mgr.smithi005.rupoiq (mgr.14195) 54 : cephadm [INF] Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-03-21T13:21:19.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:19 smithi005 bash[18615]: cephadm 2024-03-21T13:21:18.885312+0000 mgr.smithi005.rupoiq (mgr.14195) 55 : cephadm [INF] Reconfiguring daemon prometheus.smithi005 on smithi005 2024-03-21T13:21:20.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:19 smithi157 bash[23502]: cluster 2024-03-21T13:21:18.429934+0000 mgr.smithi005.rupoiq (mgr.14195) 53 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:20.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:19 smithi157 bash[23502]: audit 2024-03-21T13:21:18.572407+0000 mon.smithi005 (mon.0) 294 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:20.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:19 smithi157 bash[23502]: audit 2024-03-21T13:21:18.580351+0000 mon.smithi005 (mon.0) 295 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:20.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:19 smithi157 bash[23502]: cephadm 2024-03-21T13:21:18.627043+0000 mgr.smithi005.rupoiq (mgr.14195) 54 : cephadm [INF] Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-03-21T13:21:20.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:19 smithi157 bash[23502]: cephadm 2024-03-21T13:21:18.885312+0000 mgr.smithi005.rupoiq (mgr.14195) 55 : cephadm [INF] Reconfiguring daemon prometheus.smithi005 on smithi005 2024-03-21T13:21:20.485 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled osd.all-available-devices update... 2024-03-21T13:21:21.144 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-21T13:21:21.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: cluster 2024-03-21T13:21:20.430309+0000 mgr.smithi005.rupoiq (mgr.14195) 56 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: audit 2024-03-21T13:21:20.474463+0000 mgr.smithi005.rupoiq (mgr.14195) 57 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: cephadm 2024-03-21T13:21:20.477960+0000 mgr.smithi005.rupoiq (mgr.14195) 58 : cephadm [INF] Marking host: smithi005 for OSDSpec preview refresh. 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: cephadm 2024-03-21T13:21:20.478264+0000 mgr.smithi005.rupoiq (mgr.14195) 59 : cephadm [INF] Marking host: smithi157 for OSDSpec preview refresh. 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: cephadm 2024-03-21T13:21:20.478867+0000 mgr.smithi005.rupoiq (mgr.14195) 60 : cephadm [INF] Saving service osd.all-available-devices spec with placement * 2024-03-21T13:21:21.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:21 smithi157 bash[23502]: audit 2024-03-21T13:21:20.485701+0000 mon.smithi005 (mon.0) 296 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: cluster 2024-03-21T13:21:20.430309+0000 mgr.smithi005.rupoiq (mgr.14195) 56 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: audit 2024-03-21T13:21:20.474463+0000 mgr.smithi005.rupoiq (mgr.14195) 57 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch apply osd", "all_available_devices": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: cephadm 2024-03-21T13:21:20.477960+0000 mgr.smithi005.rupoiq (mgr.14195) 58 : cephadm [INF] Marking host: smithi005 for OSDSpec preview refresh. 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: cephadm 2024-03-21T13:21:20.478264+0000 mgr.smithi005.rupoiq (mgr.14195) 59 : cephadm [INF] Marking host: smithi157 for OSDSpec preview refresh. 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: cephadm 2024-03-21T13:21:20.478867+0000 mgr.smithi005.rupoiq (mgr.14195) 60 : cephadm [INF] Saving service osd.all-available-devices spec with placement * 2024-03-21T13:21:21.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:21 smithi005 bash[18615]: audit 2024-03-21T13:21:20.485701+0000 mon.smithi005 (mon.0) 296 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:23.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:23 smithi157 bash[23502]: cluster 2024-03-21T13:21:22.430756+0000 mgr.smithi005.rupoiq (mgr.14195) 61 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:23.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:23 smithi157 bash[23502]: audit 2024-03-21T13:21:23.425277+0000 mon.smithi005 (mon.0) 297 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:23.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:23 smithi157 bash[23502]: audit 2024-03-21T13:21:23.430262+0000 mon.smithi005 (mon.0) 298 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:23.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:23 smithi157 bash[23502]: audit 2024-03-21T13:21:23.463352+0000 mon.smithi005 (mon.0) 299 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi157", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:21:23.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:23 smithi157 bash[23502]: audit 2024-03-21T13:21:23.464328+0000 mon.smithi005 (mon.0) 300 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:23.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:23 smithi005 bash[18615]: cluster 2024-03-21T13:21:22.430756+0000 mgr.smithi005.rupoiq (mgr.14195) 61 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:23.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:23 smithi005 bash[18615]: audit 2024-03-21T13:21:23.425277+0000 mon.smithi005 (mon.0) 297 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:23.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:23 smithi005 bash[18615]: audit 2024-03-21T13:21:23.430262+0000 mon.smithi005 (mon.0) 298 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:23.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:23 smithi005 bash[18615]: audit 2024-03-21T13:21:23.463352+0000 mon.smithi005 (mon.0) 299 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi157", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-03-21T13:21:23.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:23 smithi005 bash[18615]: audit 2024-03-21T13:21:23.464328+0000 mon.smithi005 (mon.0) 300 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:24.754 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:24 smithi157 bash[23502]: cephadm 2024-03-21T13:21:23.462922+0000 mgr.smithi005.rupoiq (mgr.14195) 62 : cephadm [INF] Reconfiguring ceph-exporter.smithi157 (monmap changed)... 2024-03-21T13:21:24.754 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:24 smithi157 bash[23502]: cephadm 2024-03-21T13:21:23.465163+0000 mgr.smithi005.rupoiq (mgr.14195) 63 : cephadm [INF] Reconfiguring daemon ceph-exporter.smithi157 on smithi157 2024-03-21T13:21:24.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:24 smithi005 bash[18615]: cephadm 2024-03-21T13:21:23.462922+0000 mgr.smithi005.rupoiq (mgr.14195) 62 : cephadm [INF] Reconfiguring ceph-exporter.smithi157 (monmap changed)... 2024-03-21T13:21:24.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:24 smithi005 bash[18615]: cephadm 2024-03-21T13:21:23.465163+0000 mgr.smithi005.rupoiq (mgr.14195) 63 : cephadm [INF] Reconfiguring daemon ceph-exporter.smithi157 on smithi157 2024-03-21T13:21:25.756 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: cluster 2024-03-21T13:21:24.431173+0000 mgr.smithi005.rupoiq (mgr.14195) 64 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:25.756 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: audit 2024-03-21T13:21:24.499165+0000 mon.smithi005 (mon.0) 301 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:25.756 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: audit 2024-03-21T13:21:25.416998+0000 mon.smithi005 (mon.0) 302 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:25.757 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: audit 2024-03-21T13:21:25.426590+0000 mon.smithi005 (mon.0) 303 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:25.757 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: audit 2024-03-21T13:21:25.434757+0000 mon.smithi005 (mon.0) 304 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:21:25.757 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:25 smithi005 bash[18615]: audit 2024-03-21T13:21:25.436632+0000 mon.smithi005 (mon.0) 305 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: cluster 2024-03-21T13:21:24.431173+0000 mgr.smithi005.rupoiq (mgr.14195) 64 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: audit 2024-03-21T13:21:24.499165+0000 mon.smithi005 (mon.0) 301 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: audit 2024-03-21T13:21:25.416998+0000 mon.smithi005 (mon.0) 302 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: audit 2024-03-21T13:21:25.426590+0000 mon.smithi005 (mon.0) 303 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: audit 2024-03-21T13:21:25.434757+0000 mon.smithi005 (mon.0) 304 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-21T13:21:25.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:25 smithi157 bash[23502]: audit 2024-03-21T13:21:25.436632+0000 mon.smithi005 (mon.0) 305 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:21:26.768 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:26 smithi005 bash[18615]: cephadm 2024-03-21T13:21:25.434106+0000 mgr.smithi005.rupoiq (mgr.14195) 65 : cephadm [INF] Reconfiguring crash.smithi157 (monmap changed)... 2024-03-21T13:21:26.768 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:26 smithi005 bash[18615]: cephadm 2024-03-21T13:21:25.438549+0000 mgr.smithi005.rupoiq (mgr.14195) 66 : cephadm [INF] Reconfiguring daemon crash.smithi157 on smithi157 2024-03-21T13:21:26.770 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:26 smithi157 bash[23502]: cephadm 2024-03-21T13:21:25.434106+0000 mgr.smithi005.rupoiq (mgr.14195) 65 : cephadm [INF] Reconfiguring crash.smithi157 (monmap changed)... 2024-03-21T13:21:26.770 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:26 smithi157 bash[23502]: cephadm 2024-03-21T13:21:25.438549+0000 mgr.smithi005.rupoiq (mgr.14195) 66 : cephadm [INF] Reconfiguring daemon crash.smithi157 on smithi157 2024-03-21T13:21:27.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:27 smithi157 bash[23502]: cluster 2024-03-21T13:21:26.431688+0000 mgr.smithi005.rupoiq (mgr.14195) 67 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:27.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:27 smithi005 bash[18615]: cluster 2024-03-21T13:21:26.431688+0000 mgr.smithi005.rupoiq (mgr.14195) 67 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:28.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: audit 2024-03-21T13:21:27.523442+0000 mon.smithi005 (mon.0) 306 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: audit 2024-03-21T13:21:27.531141+0000 mon.smithi005 (mon.0) 307 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: cephadm 2024-03-21T13:21:27.559249+0000 mgr.smithi005.rupoiq (mgr.14195) 68 : cephadm [INF] Reconfiguring mgr.smithi157.xdzklg (monmap changed)... 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: audit 2024-03-21T13:21:27.559788+0000 mon.smithi005 (mon.0) 308 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.xdzklg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: audit 2024-03-21T13:21:27.561248+0000 mon.smithi005 (mon.0) 309 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: audit 2024-03-21T13:21:27.562398+0000 mon.smithi005 (mon.0) 310 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:28.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:28 smithi157 bash[23502]: cephadm 2024-03-21T13:21:27.563967+0000 mgr.smithi005.rupoiq (mgr.14195) 69 : cephadm [INF] Reconfiguring daemon mgr.smithi157.xdzklg on smithi157 2024-03-21T13:21:28.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: audit 2024-03-21T13:21:27.523442+0000 mon.smithi005 (mon.0) 306 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: audit 2024-03-21T13:21:27.531141+0000 mon.smithi005 (mon.0) 307 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: cephadm 2024-03-21T13:21:27.559249+0000 mgr.smithi005.rupoiq (mgr.14195) 68 : cephadm [INF] Reconfiguring mgr.smithi157.xdzklg (monmap changed)... 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: audit 2024-03-21T13:21:27.559788+0000 mon.smithi005 (mon.0) 308 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.xdzklg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: audit 2024-03-21T13:21:27.561248+0000 mon.smithi005 (mon.0) 309 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: audit 2024-03-21T13:21:27.562398+0000 mon.smithi005 (mon.0) 310 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:28.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:28 smithi005 bash[18615]: cephadm 2024-03-21T13:21:27.563967+0000 mgr.smithi005.rupoiq (mgr.14195) 69 : cephadm [INF] Reconfiguring daemon mgr.smithi157.xdzklg on smithi157 2024-03-21T13:21:29.232 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2024-03-21T13:21:29.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:29 smithi157 bash[23502]: cluster 2024-03-21T13:21:28.431964+0000 mgr.smithi005.rupoiq (mgr.14195) 70 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:29.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:29 smithi157 bash[23502]: audit 2024-03-21T13:21:28.615252+0000 mon.smithi005 (mon.0) 311 : audit [DBG] from='client.? 172.21.15.5:0/1473950998' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:29.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:29 smithi157 bash[23502]: audit 2024-03-21T13:21:29.479208+0000 mon.smithi005 (mon.0) 312 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:29.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:29 smithi157 bash[23502]: audit 2024-03-21T13:21:29.488893+0000 mon.smithi005 (mon.0) 313 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:29.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:29 smithi005 bash[18615]: cluster 2024-03-21T13:21:28.431964+0000 mgr.smithi005.rupoiq (mgr.14195) 70 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:29.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:29 smithi005 bash[18615]: audit 2024-03-21T13:21:28.615252+0000 mon.smithi005 (mon.0) 311 : audit [DBG] from='client.? 172.21.15.5:0/1473950998' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:29.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:29 smithi005 bash[18615]: audit 2024-03-21T13:21:29.479208+0000 mon.smithi005 (mon.0) 312 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:29.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:29 smithi005 bash[18615]: audit 2024-03-21T13:21:29.488893+0000 mon.smithi005 (mon.0) 313 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:30.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:21:30.686 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:30 smithi157 bash[23502]: cephadm 2024-03-21T13:21:29.532428+0000 mgr.smithi005.rupoiq (mgr.14195) 71 : cephadm [INF] Reconfiguring mon.smithi157 (monmap changed)... 2024-03-21T13:21:30.687 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:30 smithi157 bash[23502]: audit 2024-03-21T13:21:29.538135+0000 mon.smithi005 (mon.0) 314 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-21T13:21:30.687 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:30 smithi157 bash[23502]: audit 2024-03-21T13:21:29.540019+0000 mon.smithi005 (mon.0) 315 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-21T13:21:30.687 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:30 smithi157 bash[23502]: audit 2024-03-21T13:21:29.541807+0000 mon.smithi005 (mon.0) 316 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:30.687 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:30 smithi157 bash[23502]: cephadm 2024-03-21T13:21:29.543818+0000 mgr.smithi005.rupoiq (mgr.14195) 72 : cephadm [INF] Reconfiguring daemon mon.smithi157 on smithi157 2024-03-21T13:21:30.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:30 smithi005 bash[18615]: cephadm 2024-03-21T13:21:29.532428+0000 mgr.smithi005.rupoiq (mgr.14195) 71 : cephadm [INF] Reconfiguring mon.smithi157 (monmap changed)... 2024-03-21T13:21:30.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:30 smithi005 bash[18615]: audit 2024-03-21T13:21:29.538135+0000 mon.smithi005 (mon.0) 314 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-21T13:21:30.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:30 smithi005 bash[18615]: audit 2024-03-21T13:21:29.540019+0000 mon.smithi005 (mon.0) 315 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-21T13:21:30.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:30 smithi005 bash[18615]: audit 2024-03-21T13:21:29.541807+0000 mon.smithi005 (mon.0) 316 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:30.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:30 smithi005 bash[18615]: cephadm 2024-03-21T13:21:29.543818+0000 mgr.smithi005.rupoiq (mgr.14195) 72 : cephadm [INF] Reconfiguring daemon mon.smithi157 on smithi157 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: cluster 2024-03-21T13:21:30.432174+0000 mgr.smithi005.rupoiq (mgr.14195) 73 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: audit 2024-03-21T13:21:31.496712+0000 mon.smithi005 (mon.0) 317 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: audit 2024-03-21T13:21:31.506203+0000 mon.smithi005 (mon.0) 318 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: audit 2024-03-21T13:21:31.521386+0000 mon.smithi005 (mon.0) 319 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: audit 2024-03-21T13:21:31.524864+0000 mon.smithi005 (mon.0) 320 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005:9093"}]: dispatch 2024-03-21T13:21:31.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:31 smithi157 bash[23502]: audit 2024-03-21T13:21:31.532195+0000 mon.smithi005 (mon.0) 321 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: cluster 2024-03-21T13:21:30.432174+0000 mgr.smithi005.rupoiq (mgr.14195) 73 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: audit 2024-03-21T13:21:31.496712+0000 mon.smithi005 (mon.0) 317 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: audit 2024-03-21T13:21:31.506203+0000 mon.smithi005 (mon.0) 318 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: audit 2024-03-21T13:21:31.521386+0000 mon.smithi005 (mon.0) 319 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: audit 2024-03-21T13:21:31.524864+0000 mon.smithi005 (mon.0) 320 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005:9093"}]: dispatch 2024-03-21T13:21:31.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:31 smithi005 bash[18615]: audit 2024-03-21T13:21:31.532195+0000 mon.smithi005 (mon.0) 321 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.522392+0000 mgr.smithi005.rupoiq (mgr.14195) 74 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.525783+0000 mgr.smithi005.rupoiq (mgr.14195) 75 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005:9093"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.558220+0000 mon.smithi005 (mon.0) 322 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.558877+0000 mgr.smithi005.rupoiq (mgr.14195) 76 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.566208+0000 mon.smithi005 (mon.0) 323 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005:3000"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.566825+0000 mgr.smithi005.rupoiq (mgr.14195) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005:3000"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.572800+0000 mon.smithi005 (mon.0) 324 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.586181+0000 mon.smithi005 (mon.0) 325 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.586725+0000 mgr.smithi005.rupoiq (mgr.14195) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-21T13:21:32.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.590766+0000 mon.smithi005 (mon.0) 326 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005:9095"}]: dispatch 2024-03-21T13:21:32.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.591222+0000 mgr.smithi005.rupoiq (mgr.14195) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005:9095"}]: dispatch 2024-03-21T13:21:32.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.596440+0000 mon.smithi005 (mon.0) 327 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:32.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:32 smithi005 bash[18615]: audit 2024-03-21T13:21:31.615046+0000 mon.smithi005 (mon.0) 328 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:21:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.522392+0000 mgr.smithi005.rupoiq (mgr.14195) 74 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-21T13:21:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.525783+0000 mgr.smithi005.rupoiq (mgr.14195) 75 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005:9093"}]: dispatch 2024-03-21T13:21:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.558220+0000 mon.smithi005 (mon.0) 322 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-21T13:21:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.558877+0000 mgr.smithi005.rupoiq (mgr.14195) 76 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.566208+0000 mon.smithi005 (mon.0) 323 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005:3000"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.566825+0000 mgr.smithi005.rupoiq (mgr.14195) 77 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005:3000"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.572800+0000 mon.smithi005 (mon.0) 324 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.586181+0000 mon.smithi005 (mon.0) 325 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.586725+0000 mgr.smithi005.rupoiq (mgr.14195) 78 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.590766+0000 mon.smithi005 (mon.0) 326 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005:9095"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.591222+0000 mgr.smithi005.rupoiq (mgr.14195) 79 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005:9095"}]: dispatch 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.596440+0000 mon.smithi005 (mon.0) 327 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:32 smithi157 bash[23502]: audit 2024-03-21T13:21:31.615046+0000 mon.smithi005 (mon.0) 328 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:21:34.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:33 smithi157 bash[23502]: cluster 2024-03-21T13:21:32.432580+0000 mgr.smithi005.rupoiq (mgr.14195) 80 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:34.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:33 smithi005 bash[18615]: cluster 2024-03-21T13:21:32.432580+0000 mgr.smithi005.rupoiq (mgr.14195) 80 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:35.007 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:21:35.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:35 smithi157 bash[23502]: cluster 2024-03-21T13:21:34.432994+0000 mgr.smithi005.rupoiq (mgr.14195) 81 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:35.875 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:35 smithi005 bash[18615]: cluster 2024-03-21T13:21:34.432994+0000 mgr.smithi005.rupoiq (mgr.14195) 81 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:37.589 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: cluster 2024-03-21T13:21:36.433284+0000 mgr.smithi005.rupoiq (mgr.14195) 82 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:36.903719+0000 mon.smithi005 (mon.0) 329 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:36.910753+0000 mon.smithi005 (mon.0) 330 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.004809+0000 mon.smithi005 (mon.0) 331 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.010867+0000 mon.smithi005 (mon.0) 332 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.500424+0000 mon.smithi005 (mon.0) 333 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.513812+0000 mon.smithi005 (mon.0) 334 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.590092+0000 mon.smithi005 (mon.0) 335 : audit [DBG] from='client.? 172.21.15.5:0/1954276093' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.608741+0000 mon.smithi005 (mon.0) 336 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.613530+0000 mon.smithi005 (mon.0) 337 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.614560+0000 mon.smithi005 (mon.0) 338 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.615504+0000 mon.smithi005 (mon.0) 339 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.620877+0000 mon.smithi005 (mon.0) 340 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.624104+0000 mon.smithi005 (mon.0) 341 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.628400+0000 mon.smithi005 (mon.0) 342 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.628992+0000 mon.smithi005 (mon.0) 343 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.631951+0000 mon.smithi005 (mon.0) 344 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:21:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:37 smithi005 bash[18615]: audit 2024-03-21T13:21:37.632490+0000 mon.smithi005 (mon.0) 345 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:38.225 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"num_osds":0,"num_up_osds":0,"osd_up_since":0,"num_in_osds":0,"osd_in_since":0,"num_remapped_pgs":0} 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: cluster 2024-03-21T13:21:36.433284+0000 mgr.smithi005.rupoiq (mgr.14195) 82 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:36.903719+0000 mon.smithi005 (mon.0) 329 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:36.910753+0000 mon.smithi005 (mon.0) 330 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.004809+0000 mon.smithi005 (mon.0) 331 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.010867+0000 mon.smithi005 (mon.0) 332 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.500424+0000 mon.smithi005 (mon.0) 333 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.513812+0000 mon.smithi005 (mon.0) 334 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.590092+0000 mon.smithi005 (mon.0) 335 : audit [DBG] from='client.? 172.21.15.5:0/1954276093' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.608741+0000 mon.smithi005 (mon.0) 336 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.613530+0000 mon.smithi005 (mon.0) 337 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.614560+0000 mon.smithi005 (mon.0) 338 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.615504+0000 mon.smithi005 (mon.0) 339 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.620877+0000 mon.smithi005 (mon.0) 340 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.624104+0000 mon.smithi005 (mon.0) 341 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.628400+0000 mon.smithi005 (mon.0) 342 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.628992+0000 mon.smithi005 (mon.0) 343 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.631951+0000 mon.smithi005 (mon.0) 344 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:21:38.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:37 smithi157 bash[23502]: audit 2024-03-21T13:21:37.632490+0000 mon.smithi005 (mon.0) 345 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:21:39.226 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:21:40.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:39 smithi157 bash[23502]: cluster 2024-03-21T13:21:38.433672+0000 mgr.smithi005.rupoiq (mgr.14195) 83 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:40.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:39 smithi157 bash[23502]: audit 2024-03-21T13:21:39.496556+0000 mon.smithi005 (mon.0) 346 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:40.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:39 smithi005 bash[18615]: cluster 2024-03-21T13:21:38.433672+0000 mgr.smithi005.rupoiq (mgr.14195) 83 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:40.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:39 smithi005 bash[18615]: audit 2024-03-21T13:21:39.496556+0000 mon.smithi005 (mon.0) 346 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:42.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:41 smithi157 bash[23502]: cluster 2024-03-21T13:21:40.434109+0000 mgr.smithi005.rupoiq (mgr.14195) 84 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:42.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:41 smithi005 bash[18615]: cluster 2024-03-21T13:21:40.434109+0000 mgr.smithi005.rupoiq (mgr.14195) 84 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:21:44.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:43 smithi157 bash[23502]: cluster 2024-03-21T13:21:42.434593+0000 mgr.smithi005.rupoiq (mgr.14195) 85 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:44.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:43 smithi005 bash[18615]: cluster 2024-03-21T13:21:42.434593+0000 mgr.smithi005.rupoiq (mgr.14195) 85 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:46.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:45 smithi157 bash[23502]: cluster 2024-03-21T13:21:44.435063+0000 mgr.smithi005.rupoiq (mgr.14195) 86 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:46.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:45 smithi005 bash[18615]: cluster 2024-03-21T13:21:44.435063+0000 mgr.smithi005.rupoiq (mgr.14195) 86 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:47.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:46 smithi157 bash[23502]: audit 2024-03-21T13:21:46.500159+0000 mon.smithi157 (mon.1) 2 : audit [INF] from='client.? 172.21.15.157:0/4194021171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]: dispatch 2024-03-21T13:21:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:46 smithi157 bash[23502]: audit 2024-03-21T13:21:46.501422+0000 mon.smithi005 (mon.0) 347 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]: dispatch 2024-03-21T13:21:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:46 smithi157 bash[23502]: audit 2024-03-21T13:21:46.504775+0000 mon.smithi005 (mon.0) 348 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]': finished 2024-03-21T13:21:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:46 smithi157 bash[23502]: cluster 2024-03-21T13:21:46.510423+0000 mon.smithi005 (mon.0) 349 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-03-21T13:21:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:46 smithi157 bash[23502]: audit 2024-03-21T13:21:46.510978+0000 mon.smithi005 (mon.0) 350 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:47.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:46 smithi005 bash[18615]: audit 2024-03-21T13:21:46.500159+0000 mon.smithi157 (mon.1) 2 : audit [INF] from='client.? 172.21.15.157:0/4194021171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]: dispatch 2024-03-21T13:21:47.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:46 smithi005 bash[18615]: audit 2024-03-21T13:21:46.501422+0000 mon.smithi005 (mon.0) 347 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]: dispatch 2024-03-21T13:21:47.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:46 smithi005 bash[18615]: audit 2024-03-21T13:21:46.504775+0000 mon.smithi005 (mon.0) 348 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f4ab2013-8758-4234-bc49-0ecc066bc1b7"}]': finished 2024-03-21T13:21:47.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:46 smithi005 bash[18615]: cluster 2024-03-21T13:21:46.510423+0000 mon.smithi005 (mon.0) 349 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-03-21T13:21:47.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:46 smithi005 bash[18615]: audit 2024-03-21T13:21:46.510978+0000 mon.smithi005 (mon.0) 350 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:47.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:21:48.051 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"num_osds":2,"num_up_osds":0,"osd_up_since":0,"num_in_osds":2,"osd_in_since":1711027307,"num_remapped_pgs":0} 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: cluster 2024-03-21T13:21:46.435493+0000 mgr.smithi005.rupoiq (mgr.14195) 87 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: audit 2024-03-21T13:21:47.166322+0000 mon.smithi005 (mon.0) 351 : audit [INF] from='client.? 172.21.15.5:0/2588085875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8583d1a-19e1-4a58-a336-8430fd2b3951"}]: dispatch 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: audit 2024-03-21T13:21:47.169264+0000 mon.smithi005 (mon.0) 352 : audit [INF] from='client.? 172.21.15.5:0/2588085875' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8583d1a-19e1-4a58-a336-8430fd2b3951"}]': finished 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: cluster 2024-03-21T13:21:47.171595+0000 mon.smithi005 (mon.0) 353 : cluster [DBG] osdmap e7: 2 total, 0 up, 2 in 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: audit 2024-03-21T13:21:47.171960+0000 mon.smithi005 (mon.0) 354 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: audit 2024-03-21T13:21:47.172299+0000 mon.smithi005 (mon.0) 355 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:48.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:47 smithi157 bash[23502]: audit 2024-03-21T13:21:47.174366+0000 mon.smithi005 (mon.0) 356 : audit [DBG] from='client.? 172.21.15.5:0/3096887845' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:48.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: cluster 2024-03-21T13:21:46.435493+0000 mgr.smithi005.rupoiq (mgr.14195) 87 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:48.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: audit 2024-03-21T13:21:47.166322+0000 mon.smithi005 (mon.0) 351 : audit [INF] from='client.? 172.21.15.5:0/2588085875' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d8583d1a-19e1-4a58-a336-8430fd2b3951"}]: dispatch 2024-03-21T13:21:48.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: audit 2024-03-21T13:21:47.169264+0000 mon.smithi005 (mon.0) 352 : audit [INF] from='client.? 172.21.15.5:0/2588085875' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d8583d1a-19e1-4a58-a336-8430fd2b3951"}]': finished 2024-03-21T13:21:48.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: cluster 2024-03-21T13:21:47.171595+0000 mon.smithi005 (mon.0) 353 : cluster [DBG] osdmap e7: 2 total, 0 up, 2 in 2024-03-21T13:21:48.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: audit 2024-03-21T13:21:47.171960+0000 mon.smithi005 (mon.0) 354 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:48.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: audit 2024-03-21T13:21:47.172299+0000 mon.smithi005 (mon.0) 355 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:48.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:47 smithi005 bash[18615]: audit 2024-03-21T13:21:47.174366+0000 mon.smithi005 (mon.0) 356 : audit [DBG] from='client.? 172.21.15.5:0/3096887845' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:49.053 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:21:49.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:48 smithi157 bash[23502]: audit 2024-03-21T13:21:48.020945+0000 mon.smithi157 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.157:0/1338146450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:49.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:48 smithi005 bash[18615]: audit 2024-03-21T13:21:48.020945+0000 mon.smithi157 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.157:0/1338146450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:50.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:49 smithi157 bash[23502]: cluster 2024-03-21T13:21:48.435896+0000 mgr.smithi005.rupoiq (mgr.14195) 88 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:50.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:49 smithi157 bash[23502]: audit 2024-03-21T13:21:49.095087+0000 mon.smithi005 (mon.0) 357 : audit [DBG] from='client.? 172.21.15.5:0/2293132841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:50.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:49 smithi005 bash[18615]: cluster 2024-03-21T13:21:48.435896+0000 mgr.smithi005.rupoiq (mgr.14195) 88 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:50.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:49 smithi005 bash[18615]: audit 2024-03-21T13:21:49.095087+0000 mon.smithi005 (mon.0) 357 : audit [DBG] from='client.? 172.21.15.5:0/2293132841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.867889+0000 mon.smithi157 (mon.1) 4 : audit [INF] from='client.? 172.21.15.157:0/2291489098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]: dispatch 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.868852+0000 mon.smithi005 (mon.0) 358 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]: dispatch 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.871296+0000 mon.smithi005 (mon.0) 359 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]': finished 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: cluster 2024-03-21T13:21:50.874034+0000 mon.smithi005 (mon.0) 360 : cluster [DBG] osdmap e8: 3 total, 0 up, 3 in 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.874299+0000 mon.smithi005 (mon.0) 361 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.874640+0000 mon.smithi005 (mon.0) 362 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:50 smithi157 bash[23502]: audit 2024-03-21T13:21:50.874971+0000 mon.smithi005 (mon.0) 363 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:51.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.867889+0000 mon.smithi157 (mon.1) 4 : audit [INF] from='client.? 172.21.15.157:0/2291489098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]: dispatch 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.868852+0000 mon.smithi005 (mon.0) 358 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]: dispatch 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.871296+0000 mon.smithi005 (mon.0) 359 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30b48e81-eb62-4855-a3eb-ba35f36396a1"}]': finished 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: cluster 2024-03-21T13:21:50.874034+0000 mon.smithi005 (mon.0) 360 : cluster [DBG] osdmap e8: 3 total, 0 up, 3 in 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.874299+0000 mon.smithi005 (mon.0) 361 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.874640+0000 mon.smithi005 (mon.0) 362 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:51.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:50 smithi005 bash[18615]: audit 2024-03-21T13:21:50.874971+0000 mon.smithi005 (mon.0) 363 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:52.263 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:51 smithi005 bash[18615]: cluster 2024-03-21T13:21:50.436318+0000 mgr.smithi005.rupoiq (mgr.14195) 89 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:52.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:51 smithi157 bash[23502]: cluster 2024-03-21T13:21:50.436318+0000 mgr.smithi005.rupoiq (mgr.14195) 89 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:51.999090+0000 mon.smithi005 (mon.0) 364 : audit [INF] from='client.? 172.21.15.5:0/3719876223' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7190feda-ce14-494f-921c-c2452a04bd26"}]: dispatch 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.001254+0000 mon.smithi005 (mon.0) 365 : audit [INF] from='client.? 172.21.15.5:0/3719876223' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7190feda-ce14-494f-921c-c2452a04bd26"}]': finished 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: cluster 2024-03-21T13:21:52.006137+0000 mon.smithi005 (mon.0) 366 : cluster [DBG] osdmap e9: 4 total, 0 up, 4 in 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.006453+0000 mon.smithi005 (mon.0) 367 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.006696+0000 mon.smithi005 (mon.0) 368 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.006893+0000 mon.smithi005 (mon.0) 369 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.007129+0000 mon.smithi005 (mon.0) 370 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:52 smithi157 bash[23502]: audit 2024-03-21T13:21:52.454133+0000 mon.smithi157 (mon.1) 5 : audit [DBG] from='client.? 172.21.15.157:0/3940878193' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:53.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:51.999090+0000 mon.smithi005 (mon.0) 364 : audit [INF] from='client.? 172.21.15.5:0/3719876223' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7190feda-ce14-494f-921c-c2452a04bd26"}]: dispatch 2024-03-21T13:21:53.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.001254+0000 mon.smithi005 (mon.0) 365 : audit [INF] from='client.? 172.21.15.5:0/3719876223' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7190feda-ce14-494f-921c-c2452a04bd26"}]': finished 2024-03-21T13:21:53.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: cluster 2024-03-21T13:21:52.006137+0000 mon.smithi005 (mon.0) 366 : cluster [DBG] osdmap e9: 4 total, 0 up, 4 in 2024-03-21T13:21:53.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.006453+0000 mon.smithi005 (mon.0) 367 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:53.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.006696+0000 mon.smithi005 (mon.0) 368 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:53.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.006893+0000 mon.smithi005 (mon.0) 369 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:53.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.007129+0000 mon.smithi005 (mon.0) 370 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:53.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:52 smithi005 bash[18615]: audit 2024-03-21T13:21:52.454133+0000 mon.smithi157 (mon.1) 5 : audit [DBG] from='client.? 172.21.15.157:0/3940878193' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:53.813 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:21:54.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:53 smithi157 bash[23502]: cluster 2024-03-21T13:21:52.436724+0000 mgr.smithi005.rupoiq (mgr.14195) 90 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:54.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:53 smithi157 bash[23502]: audit 2024-03-21T13:21:53.685822+0000 mon.smithi005 (mon.0) 371 : audit [DBG] from='client.? 172.21.15.5:0/388177981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:54.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:53 smithi005 bash[18615]: cluster 2024-03-21T13:21:52.436724+0000 mgr.smithi005.rupoiq (mgr.14195) 90 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:54.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:53 smithi005 bash[18615]: audit 2024-03-21T13:21:53.685822+0000 mon.smithi005 (mon.0) 371 : audit [DBG] from='client.? 172.21.15.5:0/388177981' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:55.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:54 smithi005 bash[18615]: audit 2024-03-21T13:21:54.496902+0000 mon.smithi005 (mon.0) 372 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:55.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:54 smithi157 bash[23502]: audit 2024-03-21T13:21:54.496902+0000 mon.smithi005 (mon.0) 372 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: cluster 2024-03-21T13:21:54.437118+0000 mgr.smithi005.rupoiq (mgr.14195) 91 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.306929+0000 mon.smithi157 (mon.1) 6 : audit [INF] from='client.? 172.21.15.157:0/1190894512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]: dispatch 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.308059+0000 mon.smithi005 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]: dispatch 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.311365+0000 mon.smithi005 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]': finished 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: cluster 2024-03-21T13:21:55.316199+0000 mon.smithi005 (mon.0) 375 : cluster [DBG] osdmap e10: 5 total, 0 up, 5 in 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.316778+0000 mon.smithi005 (mon.0) 376 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:56.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.317243+0000 mon.smithi005 (mon.0) 377 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:56.116 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.317764+0000 mon.smithi005 (mon.0) 378 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:56.116 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.318227+0000 mon.smithi005 (mon.0) 379 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:56.116 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:55 smithi005 bash[18615]: audit 2024-03-21T13:21:55.318680+0000 mon.smithi005 (mon.0) 380 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: cluster 2024-03-21T13:21:54.437118+0000 mgr.smithi005.rupoiq (mgr.14195) 91 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.306929+0000 mon.smithi157 (mon.1) 6 : audit [INF] from='client.? 172.21.15.157:0/1190894512' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.308059+0000 mon.smithi005 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.311365+0000 mon.smithi005 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce"}]': finished 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: cluster 2024-03-21T13:21:55.316199+0000 mon.smithi005 (mon.0) 375 : cluster [DBG] osdmap e10: 5 total, 0 up, 5 in 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.316778+0000 mon.smithi005 (mon.0) 376 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.317243+0000 mon.smithi005 (mon.0) 377 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.317764+0000 mon.smithi005 (mon.0) 378 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.318227+0000 mon.smithi005 (mon.0) 379 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:56.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:55 smithi157 bash[23502]: audit 2024-03-21T13:21:55.318680+0000 mon.smithi005 (mon.0) 380 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:21:56.519 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.520176+0000 mon.smithi005 (mon.0) 381 : audit [DBG] from='client.? 172.21.15.5:0/3297095944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.549009+0000 mon.smithi005 (mon.0) 382 : audit [INF] from='client.? 172.21.15.5:0/2299999887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd0171b3-2226-4a0c-888a-c585d7b57ad3"}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.550961+0000 mon.smithi005 (mon.0) 383 : audit [INF] from='client.? 172.21.15.5:0/2299999887' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd0171b3-2226-4a0c-888a-c585d7b57ad3"}]': finished 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: cluster 2024-03-21T13:21:56.554083+0000 mon.smithi005 (mon.0) 384 : cluster [DBG] osdmap e11: 6 total, 0 up, 6 in 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.554285+0000 mon.smithi005 (mon.0) 385 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.554431+0000 mon.smithi005 (mon.0) 386 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.554662+0000 mon.smithi005 (mon.0) 387 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.554820+0000 mon.smithi005 (mon.0) 388 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.554979+0000 mon.smithi005 (mon.0) 389 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:21:57.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:56 smithi005 bash[18615]: audit 2024-03-21T13:21:56.555146+0000 mon.smithi005 (mon.0) 390 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.520176+0000 mon.smithi005 (mon.0) 381 : audit [DBG] from='client.? 172.21.15.5:0/3297095944' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.549009+0000 mon.smithi005 (mon.0) 382 : audit [INF] from='client.? 172.21.15.5:0/2299999887' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd0171b3-2226-4a0c-888a-c585d7b57ad3"}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.550961+0000 mon.smithi005 (mon.0) 383 : audit [INF] from='client.? 172.21.15.5:0/2299999887' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd0171b3-2226-4a0c-888a-c585d7b57ad3"}]': finished 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: cluster 2024-03-21T13:21:56.554083+0000 mon.smithi005 (mon.0) 384 : cluster [DBG] osdmap e11: 6 total, 0 up, 6 in 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.554285+0000 mon.smithi005 (mon.0) 385 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.554431+0000 mon.smithi005 (mon.0) 386 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.554662+0000 mon.smithi005 (mon.0) 387 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:21:57.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.554820+0000 mon.smithi005 (mon.0) 388 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:21:57.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.554979+0000 mon.smithi005 (mon.0) 389 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:21:57.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:56 smithi157 bash[23502]: audit 2024-03-21T13:21:56.555146+0000 mon.smithi005 (mon.0) 390 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:21:57.417 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"num_osds":5,"num_up_osds":0,"osd_up_since":0,"num_in_osds":5,"osd_in_since":1711027315,"num_remapped_pgs":0} 2024-03-21T13:21:58.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:57 smithi157 bash[23502]: cluster 2024-03-21T13:21:56.437426+0000 mgr.smithi005.rupoiq (mgr.14195) 92 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:58.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:57 smithi157 bash[23502]: audit 2024-03-21T13:21:57.016375+0000 mon.smithi157 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.157:0/1835252878' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:58.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:57 smithi005 bash[18615]: cluster 2024-03-21T13:21:56.437426+0000 mgr.smithi005.rupoiq (mgr.14195) 92 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:21:58.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:57 smithi005 bash[18615]: audit 2024-03-21T13:21:57.016375+0000 mon.smithi157 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.157:0/1835252878' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:58.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:21:59.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:58 smithi157 bash[23502]: audit 2024-03-21T13:21:58.440470+0000 mon.smithi005 (mon.0) 391 : audit [DBG] from='client.? 172.21.15.5:0/4216320385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:21:59.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:58 smithi005 bash[18615]: audit 2024-03-21T13:21:58.440470+0000 mon.smithi005 (mon.0) 391 : audit [DBG] from='client.? 172.21.15.5:0/4216320385' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: cluster 2024-03-21T13:21:58.437815+0000 mgr.smithi005.rupoiq (mgr.14195) 93 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.861939+0000 mon.smithi157 (mon.1) 8 : audit [INF] from='client.? 172.21.15.157:0/1704465113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.862803+0000 mon.smithi005 (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.864882+0000 mon.smithi005 (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]': finished 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: cluster 2024-03-21T13:21:59.867405+0000 mon.smithi005 (mon.0) 394 : cluster [DBG] osdmap e12: 7 total, 0 up, 7 in 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.867615+0000 mon.smithi005 (mon.0) 395 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.867844+0000 mon.smithi005 (mon.0) 396 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.868064+0000 mon.smithi005 (mon.0) 397 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.868260+0000 mon.smithi005 (mon.0) 398 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:00.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.868467+0000 mon.smithi005 (mon.0) 399 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:00.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.868666+0000 mon.smithi005 (mon.0) 400 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:00.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:21:59 smithi157 bash[23502]: audit 2024-03-21T13:21:59.868868+0000 mon.smithi005 (mon.0) 401 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: cluster 2024-03-21T13:21:58.437815+0000 mgr.smithi005.rupoiq (mgr.14195) 93 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.861939+0000 mon.smithi157 (mon.1) 8 : audit [INF] from='client.? 172.21.15.157:0/1704465113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.862803+0000 mon.smithi005 (mon.0) 392 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.864882+0000 mon.smithi005 (mon.0) 393 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1782d9b-12a6-43a9-8977-a968a6e0ec19"}]': finished 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: cluster 2024-03-21T13:21:59.867405+0000 mon.smithi005 (mon.0) 394 : cluster [DBG] osdmap e12: 7 total, 0 up, 7 in 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.867615+0000 mon.smithi005 (mon.0) 395 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.867844+0000 mon.smithi005 (mon.0) 396 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.868064+0000 mon.smithi005 (mon.0) 397 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.868260+0000 mon.smithi005 (mon.0) 398 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.868467+0000 mon.smithi005 (mon.0) 399 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.868666+0000 mon.smithi005 (mon.0) 400 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:00.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:21:59 smithi005 bash[18615]: audit 2024-03-21T13:21:59.868868+0000 mon.smithi005 (mon.0) 401 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:01.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:01 smithi157 bash[23502]: cluster 2024-03-21T13:22:00.438241+0000 mgr.smithi005.rupoiq (mgr.14195) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:01.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:01 smithi005 bash[18615]: cluster 2024-03-21T13:22:00.438241+0000 mgr.smithi005.rupoiq (mgr.14195) 94 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:02.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.355068+0000 mon.smithi005 (mon.0) 402 : audit [INF] from='client.? 172.21.15.5:0/3464122172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b372199-2b09-45d5-b8d5-e757aaa0fd37"}]: dispatch 2024-03-21T13:22:02.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.357790+0000 mon.smithi005 (mon.0) 403 : audit [INF] from='client.? 172.21.15.5:0/3464122172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b372199-2b09-45d5-b8d5-e757aaa0fd37"}]': finished 2024-03-21T13:22:02.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: cluster 2024-03-21T13:22:01.361273+0000 mon.smithi005 (mon.0) 404 : cluster [DBG] osdmap e13: 8 total, 0 up, 8 in 2024-03-21T13:22:02.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.361604+0000 mon.smithi005 (mon.0) 405 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.361924+0000 mon.smithi005 (mon.0) 406 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.362212+0000 mon.smithi005 (mon.0) 407 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.362529+0000 mon.smithi005 (mon.0) 408 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.362802+0000 mon.smithi005 (mon.0) 409 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.363067+0000 mon.smithi005 (mon.0) 410 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.363331+0000 mon.smithi005 (mon.0) 411 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.363589+0000 mon.smithi005 (mon.0) 412 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:02.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:02 smithi157 bash[23502]: audit 2024-03-21T13:22:01.491325+0000 mon.smithi157 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.157:0/972772587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.355068+0000 mon.smithi005 (mon.0) 402 : audit [INF] from='client.? 172.21.15.5:0/3464122172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b372199-2b09-45d5-b8d5-e757aaa0fd37"}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.357790+0000 mon.smithi005 (mon.0) 403 : audit [INF] from='client.? 172.21.15.5:0/3464122172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b372199-2b09-45d5-b8d5-e757aaa0fd37"}]': finished 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: cluster 2024-03-21T13:22:01.361273+0000 mon.smithi005 (mon.0) 404 : cluster [DBG] osdmap e13: 8 total, 0 up, 8 in 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.361604+0000 mon.smithi005 (mon.0) 405 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.361924+0000 mon.smithi005 (mon.0) 406 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.362212+0000 mon.smithi005 (mon.0) 407 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.362529+0000 mon.smithi005 (mon.0) 408 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.362802+0000 mon.smithi005 (mon.0) 409 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.363067+0000 mon.smithi005 (mon.0) 410 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:02.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.363331+0000 mon.smithi005 (mon.0) 411 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:02.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.363589+0000 mon.smithi005 (mon.0) 412 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:02.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:02 smithi005 bash[18615]: audit 2024-03-21T13:22:01.491325+0000 mon.smithi157 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.157:0/972772587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:22:03.187 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:22:03.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:03 smithi157 bash[23502]: cluster 2024-03-21T13:22:02.438761+0000 mgr.smithi005.rupoiq (mgr.14195) 95 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:03.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:03 smithi005 bash[18615]: cluster 2024-03-21T13:22:02.438761+0000 mgr.smithi005.rupoiq (mgr.14195) 95 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:04 smithi157 bash[23502]: audit 2024-03-21T13:22:03.079212+0000 mon.smithi005 (mon.0) 413 : audit [DBG] from='client.? 172.21.15.5:0/1144165628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:22:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:04 smithi005 bash[18615]: audit 2024-03-21T13:22:03.079212+0000 mon.smithi005 (mon.0) 413 : audit [DBG] from='client.? 172.21.15.5:0/1144165628' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-21T13:22:05.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:05 smithi005 bash[18615]: cluster 2024-03-21T13:22:04.439181+0000 mgr.smithi005.rupoiq (mgr.14195) 96 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:05.425 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:05 smithi157 bash[23502]: cluster 2024-03-21T13:22:04.439181+0000 mgr.smithi005.rupoiq (mgr.14195) 96 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:06.094 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:22:06.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:06 smithi157 bash[23502]: audit 2024-03-21T13:22:06.094850+0000 mon.smithi005 (mon.0) 414 : audit [DBG] from='client.? 172.21.15.5:0/1168007271' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:06.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:06 smithi005 bash[18615]: audit 2024-03-21T13:22:06.094850+0000 mon.smithi005 (mon.0) 414 : audit [DBG] from='client.? 172.21.15.5:0/1168007271' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:06.757 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1711027321,"num_remapped_pgs":0} 2024-03-21T13:22:07.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:07 smithi157 bash[23502]: cluster 2024-03-21T13:22:06.439523+0000 mgr.smithi005.rupoiq (mgr.14195) 97 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:07.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:07 smithi005 bash[18615]: cluster 2024-03-21T13:22:06.439523+0000 mgr.smithi005.rupoiq (mgr.14195) 97 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:07.758 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:22:09.779 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:09 smithi157 bash[23502]: cluster 2024-03-21T13:22:08.439957+0000 mgr.smithi005.rupoiq (mgr.14195) 98 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:09.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:09 smithi005 bash[18615]: cluster 2024-03-21T13:22:08.439957+0000 mgr.smithi005.rupoiq (mgr.14195) 98 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:10.690 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:10 smithi157 bash[23502]: audit 2024-03-21T13:22:09.500554+0000 mon.smithi005 (mon.0) 415 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:10.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:10 smithi005 bash[18615]: audit 2024-03-21T13:22:09.500554+0000 mon.smithi005 (mon.0) 415 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:11.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:11 smithi157 bash[23502]: cluster 2024-03-21T13:22:10.440399+0000 mgr.smithi005.rupoiq (mgr.14195) 99 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:11.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:11 smithi005 bash[18615]: cluster 2024-03-21T13:22:10.440399+0000 mgr.smithi005.rupoiq (mgr.14195) 99 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:12.376 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:22:13.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:13 smithi005 bash[18615]: cluster 2024-03-21T13:22:12.440704+0000 mgr.smithi005.rupoiq (mgr.14195) 100 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:13.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:13 smithi005 bash[18615]: audit 2024-03-21T13:22:13.201754+0000 mon.smithi005 (mon.0) 416 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-21T13:22:13.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:13 smithi005 bash[18615]: audit 2024-03-21T13:22:13.203629+0000 mon.smithi005 (mon.0) 417 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:13.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:13 smithi157 bash[23502]: cluster 2024-03-21T13:22:12.440704+0000 mgr.smithi005.rupoiq (mgr.14195) 100 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:13.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:13 smithi157 bash[23502]: audit 2024-03-21T13:22:13.201754+0000 mon.smithi005 (mon.0) 416 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-21T13:22:13.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:13 smithi157 bash[23502]: audit 2024-03-21T13:22:13.203629+0000 mon.smithi005 (mon.0) 417 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:14.724 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:14 smithi157 bash[23502]: cephadm 2024-03-21T13:22:13.205355+0000 mgr.smithi005.rupoiq (mgr.14195) 101 : cephadm [INF] Deploying daemon osd.0 on smithi157 2024-03-21T13:22:14.822 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:14 smithi005 bash[18615]: cephadm 2024-03-21T13:22:13.205355+0000 mgr.smithi005.rupoiq (mgr.14195) 101 : cephadm [INF] Deploying daemon osd.0 on smithi157 2024-03-21T13:22:15.757 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:15 smithi005 bash[18615]: cluster 2024-03-21T13:22:14.441032+0000 mgr.smithi005.rupoiq (mgr.14195) 102 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:15.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:15 smithi157 bash[23502]: cluster 2024-03-21T13:22:14.441032+0000 mgr.smithi005.rupoiq (mgr.14195) 102 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:16.692 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:22:16.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:16 smithi157 bash[23502]: audit 2024-03-21T13:22:16.300066+0000 mon.smithi005 (mon.0) 418 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-21T13:22:16.793 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:16 smithi157 bash[23502]: audit 2024-03-21T13:22:16.300994+0000 mon.smithi005 (mon.0) 419 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:16.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:16 smithi005 bash[18615]: audit 2024-03-21T13:22:16.300066+0000 mon.smithi005 (mon.0) 418 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-21T13:22:16.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:16 smithi005 bash[18615]: audit 2024-03-21T13:22:16.300994+0000 mon.smithi005 (mon.0) 419 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:17.468 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:17 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:17.759 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:17 smithi157 bash[23502]: cephadm 2024-03-21T13:22:16.301844+0000 mgr.smithi005.rupoiq (mgr.14195) 103 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-03-21T13:22:17.759 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:17 smithi157 bash[23502]: cluster 2024-03-21T13:22:16.441471+0000 mgr.smithi005.rupoiq (mgr.14195) 104 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:17.759 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:17 smithi157 bash[23502]: audit 2024-03-21T13:22:16.692817+0000 mon.smithi005 (mon.0) 420 : audit [DBG] from='client.? 172.21.15.5:0/968704008' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:17.759 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:17 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:17.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:17 smithi005 bash[18615]: cephadm 2024-03-21T13:22:16.301844+0000 mgr.smithi005.rupoiq (mgr.14195) 103 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-03-21T13:22:17.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:17 smithi005 bash[18615]: cluster 2024-03-21T13:22:16.441471+0000 mgr.smithi005.rupoiq (mgr.14195) 104 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:17.806 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:17 smithi005 bash[18615]: audit 2024-03-21T13:22:16.692817+0000 mon.smithi005 (mon.0) 420 : audit [DBG] from='client.? 172.21.15.5:0/968704008' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:17.894 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"num_osds":8,"num_up_osds":0,"osd_up_since":0,"num_in_osds":8,"osd_in_since":1711027321,"num_remapped_pgs":0} 2024-03-21T13:22:18.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:22:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:18 smithi157 bash[23502]: audit 2024-03-21T13:22:17.764738+0000 mon.smithi005 (mon.0) 421 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:18 smithi157 bash[23502]: audit 2024-03-21T13:22:17.774381+0000 mon.smithi005 (mon.0) 422 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:18 smithi157 bash[23502]: audit 2024-03-21T13:22:17.776449+0000 mon.smithi005 (mon.0) 423 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-21T13:22:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:18 smithi157 bash[23502]: audit 2024-03-21T13:22:17.778294+0000 mon.smithi005 (mon.0) 424 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:19.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:18 smithi157 bash[23502]: cephadm 2024-03-21T13:22:17.779965+0000 mgr.smithi005.rupoiq (mgr.14195) 105 : cephadm [INF] Deploying daemon osd.2 on smithi157 2024-03-21T13:22:19.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:18 smithi005 bash[18615]: audit 2024-03-21T13:22:17.764738+0000 mon.smithi005 (mon.0) 421 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:19.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:18 smithi005 bash[18615]: audit 2024-03-21T13:22:17.774381+0000 mon.smithi005 (mon.0) 422 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:19.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:18 smithi005 bash[18615]: audit 2024-03-21T13:22:17.776449+0000 mon.smithi005 (mon.0) 423 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-21T13:22:19.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:18 smithi005 bash[18615]: audit 2024-03-21T13:22:17.778294+0000 mon.smithi005 (mon.0) 424 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:19.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:18 smithi005 bash[18615]: cephadm 2024-03-21T13:22:17.779965+0000 mgr.smithi005.rupoiq (mgr.14195) 105 : cephadm [INF] Deploying daemon osd.2 on smithi157 2024-03-21T13:22:20.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:19 smithi157 bash[23502]: cluster 2024-03-21T13:22:18.441942+0000 mgr.smithi005.rupoiq (mgr.14195) 106 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:20.049 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:19 smithi005 bash[18615]: cluster 2024-03-21T13:22:18.441942+0000 mgr.smithi005.rupoiq (mgr.14195) 106 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:21.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:21.490 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:22.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:21 smithi157 bash[23502]: cluster 2024-03-21T13:22:20.442350+0000 mgr.smithi005.rupoiq (mgr.14195) 107 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:22.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:21 smithi157 bash[23502]: audit 2024-03-21T13:22:21.534980+0000 mon.smithi005 (mon.0) 425 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:22.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:21 smithi157 bash[23502]: audit 2024-03-21T13:22:21.540336+0000 mon.smithi005 (mon.0) 426 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:22.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:21 smithi157 bash[23502]: audit 2024-03-21T13:22:21.541220+0000 mon.smithi005 (mon.0) 427 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-21T13:22:22.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:21 smithi157 bash[23502]: audit 2024-03-21T13:22:21.541920+0000 mon.smithi005 (mon.0) 428 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 bash[18615]: cluster 2024-03-21T13:22:20.442350+0000 mgr.smithi005.rupoiq (mgr.14195) 107 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 bash[18615]: audit 2024-03-21T13:22:21.534980+0000 mon.smithi005 (mon.0) 425 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 bash[18615]: audit 2024-03-21T13:22:21.540336+0000 mon.smithi005 (mon.0) 426 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 bash[18615]: audit 2024-03-21T13:22:21.541220+0000 mon.smithi005 (mon.0) 427 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-21T13:22:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:21 smithi005 bash[18615]: audit 2024-03-21T13:22:21.541920+0000 mon.smithi005 (mon.0) 428 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:22.948 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:22 smithi157 bash[23502]: cephadm 2024-03-21T13:22:21.542529+0000 mgr.smithi005.rupoiq (mgr.14195) 108 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-03-21T13:22:23.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:22 smithi005 bash[18615]: cephadm 2024-03-21T13:22:21.542529+0000 mgr.smithi005.rupoiq (mgr.14195) 108 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-03-21T13:22:23.202 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:23.451 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:24.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 bash[23502]: cluster 2024-03-21T13:22:22.442793+0000 mgr.smithi005.rupoiq (mgr.14195) 109 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:24.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 bash[23502]: audit 2024-03-21T13:22:23.495576+0000 mon.smithi005 (mon.0) 429 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:24.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 bash[23502]: audit 2024-03-21T13:22:23.499787+0000 mon.smithi005 (mon.0) 430 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:24.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 bash[23502]: audit 2024-03-21T13:22:23.500751+0000 mon.smithi005 (mon.0) 431 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-21T13:22:24.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:23 smithi157 bash[23502]: audit 2024-03-21T13:22:23.501538+0000 mon.smithi005 (mon.0) 432 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:24.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:23 smithi005 bash[18615]: cluster 2024-03-21T13:22:22.442793+0000 mgr.smithi005.rupoiq (mgr.14195) 109 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:24.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:23 smithi005 bash[18615]: audit 2024-03-21T13:22:23.495576+0000 mon.smithi005 (mon.0) 429 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:24.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:23 smithi005 bash[18615]: audit 2024-03-21T13:22:23.499787+0000 mon.smithi005 (mon.0) 430 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:24.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:23 smithi005 bash[18615]: audit 2024-03-21T13:22:23.500751+0000 mon.smithi005 (mon.0) 431 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-21T13:22:24.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:23 smithi005 bash[18615]: audit 2024-03-21T13:22:23.501538+0000 mon.smithi005 (mon.0) 432 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:24.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:24 smithi005 bash[18615]: cephadm 2024-03-21T13:22:23.502252+0000 mgr.smithi005.rupoiq (mgr.14195) 110 : cephadm [INF] Deploying daemon osd.4 on smithi157 2024-03-21T13:22:24.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:24 smithi005 bash[18615]: audit 2024-03-21T13:22:24.497969+0000 mon.smithi005 (mon.0) 433 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:25.038 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:24 smithi157 bash[23502]: cephadm 2024-03-21T13:22:23.502252+0000 mgr.smithi005.rupoiq (mgr.14195) 110 : cephadm [INF] Deploying daemon osd.4 on smithi157 2024-03-21T13:22:25.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:24 smithi157 bash[23502]: audit 2024-03-21T13:22:24.497969+0000 mon.smithi005 (mon.0) 433 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:25.359 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:22:25.954 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:25 smithi005 bash[18615]: cluster 2024-03-21T13:22:24.443252+0000 mgr.smithi005.rupoiq (mgr.14195) 111 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:25.954 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:25 smithi005 bash[18615]: audit 2024-03-21T13:22:25.784676+0000 mon.smithi157 (mon.1) 10 : audit [INF] from='osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-21T13:22:25.954 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:25 smithi005 bash[18615]: audit 2024-03-21T13:22:25.785456+0000 mon.smithi005 (mon.0) 434 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-21T13:22:26.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:25 smithi157 bash[23502]: cluster 2024-03-21T13:22:24.443252+0000 mgr.smithi005.rupoiq (mgr.14195) 111 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:26.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:25 smithi157 bash[23502]: audit 2024-03-21T13:22:25.784676+0000 mon.smithi157 (mon.1) 10 : audit [INF] from='osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-21T13:22:26.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:25 smithi157 bash[23502]: audit 2024-03-21T13:22:25.785456+0000 mon.smithi005 (mon.0) 434 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-21T13:22:26.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.801071+0000 mon.smithi005 (mon.0) 435 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-21T13:22:26.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: cluster 2024-03-21T13:22:25.802941+0000 mon.smithi005 (mon.0) 436 : cluster [DBG] osdmap e14: 8 total, 0 up, 8 in 2024-03-21T13:22:26.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.803084+0000 mon.smithi157 (mon.1) 11 : audit [INF] from='osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:26.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.803153+0000 mon.smithi005 (mon.0) 437 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:26.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.803367+0000 mon.smithi005 (mon.0) 438 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.803671+0000 mon.smithi005 (mon.0) 439 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.803975+0000 mon.smithi005 (mon.0) 440 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.804218+0000 mon.smithi005 (mon.0) 441 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.804399+0000 mon.smithi005 (mon.0) 442 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.804569+0000 mon.smithi005 (mon.0) 443 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.804763+0000 mon.smithi005 (mon.0) 444 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:26.934 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:26 smithi005 bash[18615]: audit 2024-03-21T13:22:25.804953+0000 mon.smithi005 (mon.0) 445 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:27.134 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.801071+0000 mon.smithi005 (mon.0) 435 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: cluster 2024-03-21T13:22:25.802941+0000 mon.smithi005 (mon.0) 436 : cluster [DBG] osdmap e14: 8 total, 0 up, 8 in 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.803084+0000 mon.smithi157 (mon.1) 11 : audit [INF] from='osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.803153+0000 mon.smithi005 (mon.0) 437 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.803367+0000 mon.smithi005 (mon.0) 438 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.803671+0000 mon.smithi005 (mon.0) 439 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.803975+0000 mon.smithi005 (mon.0) 440 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.804218+0000 mon.smithi005 (mon.0) 441 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.804399+0000 mon.smithi005 (mon.0) 442 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.804569+0000 mon.smithi005 (mon.0) 443 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.804763+0000 mon.smithi005 (mon.0) 444 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:27.135 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:26 smithi157 bash[23502]: audit 2024-03-21T13:22:25.804953+0000 mon.smithi005 (mon.0) 445 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:27.804 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:27.805 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:27.971 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: cluster 2024-03-21T13:22:26.443734+0000 mgr.smithi005.rupoiq (mgr.14195) 112 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.803520+0000 mon.smithi005 (mon.0) 446 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: cluster 2024-03-21T13:22:26.808508+0000 mon.smithi005 (mon.0) 447 : cluster [DBG] osdmap e15: 8 total, 0 up, 8 in 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.809453+0000 mon.smithi005 (mon.0) 448 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.810081+0000 mon.smithi005 (mon.0) 449 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.817339+0000 mon.smithi005 (mon.0) 450 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.817737+0000 mon.smithi005 (mon.0) 451 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.818200+0000 mon.smithi005 (mon.0) 452 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.818581+0000 mon.smithi005 (mon.0) 453 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.818998+0000 mon.smithi005 (mon.0) 454 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.819387+0000 mon.smithi005 (mon.0) 455 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:26.819885+0000 mon.smithi005 (mon.0) 456 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:27 smithi157 bash[23502]: audit 2024-03-21T13:22:27.139407+0000 mon.smithi005 (mon.0) 457 : audit [INF] from='osd.0 ' entity='osd.0' 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: cluster 2024-03-21T13:22:26.443734+0000 mgr.smithi005.rupoiq (mgr.14195) 112 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.803520+0000 mon.smithi005 (mon.0) 446 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: cluster 2024-03-21T13:22:26.808508+0000 mon.smithi005 (mon.0) 447 : cluster [DBG] osdmap e15: 8 total, 0 up, 8 in 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.809453+0000 mon.smithi005 (mon.0) 448 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.810081+0000 mon.smithi005 (mon.0) 449 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.817339+0000 mon.smithi005 (mon.0) 450 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.817737+0000 mon.smithi005 (mon.0) 451 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.818200+0000 mon.smithi005 (mon.0) 452 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:28.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.818581+0000 mon.smithi005 (mon.0) 453 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:28.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.818998+0000 mon.smithi005 (mon.0) 454 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:28.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.819387+0000 mon.smithi005 (mon.0) 455 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:28.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:26.819885+0000 mon.smithi005 (mon.0) 456 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:28.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:27 smithi005 bash[18615]: audit 2024-03-21T13:22:27.139407+0000 mon.smithi005 (mon.0) 457 : audit [INF] from='osd.0 ' entity='osd.0' 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: cluster 2024-03-21T13:22:26.745223+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: cluster 2024-03-21T13:22:26.745634+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:27.815876+0000 mon.smithi005 (mon.0) 458 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:27.970756+0000 mon.smithi005 (mon.0) 459 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:27.977060+0000 mon.smithi005 (mon.0) 460 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:27.978146+0000 mon.smithi005 (mon.0) 461 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:27.978872+0000 mon.smithi005 (mon.0) 462 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: cephadm 2024-03-21T13:22:27.979555+0000 mgr.smithi005.rupoiq (mgr.14195) 113 : cephadm [INF] Deploying daemon osd.5 on smithi005 2024-03-21T13:22:28.968 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: cluster 2024-03-21T13:22:28.143992+0000 mon.smithi005 (mon.0) 463 : cluster [INF] osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579] boot 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: cluster 2024-03-21T13:22:28.144110+0000 mon.smithi005 (mon.0) 464 : cluster [DBG] osdmap e16: 8 total, 1 up, 8 in 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.144304+0000 mon.smithi005 (mon.0) 465 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.144788+0000 mon.smithi005 (mon.0) 466 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.145034+0000 mon.smithi005 (mon.0) 467 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.145271+0000 mon.smithi005 (mon.0) 468 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.145506+0000 mon.smithi005 (mon.0) 469 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.145735+0000 mon.smithi005 (mon.0) 470 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.145973+0000 mon.smithi005 (mon.0) 471 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 bash[23502]: audit 2024-03-21T13:22:28.146202+0000 mon.smithi005 (mon.0) 472 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:28.969 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:28 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:29.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: cluster 2024-03-21T13:22:26.745223+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: cluster 2024-03-21T13:22:26.745634+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:27.815876+0000 mon.smithi005 (mon.0) 458 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:27.970756+0000 mon.smithi005 (mon.0) 459 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:27.977060+0000 mon.smithi005 (mon.0) 460 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:27.978146+0000 mon.smithi005 (mon.0) 461 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:27.978872+0000 mon.smithi005 (mon.0) 462 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: cephadm 2024-03-21T13:22:27.979555+0000 mgr.smithi005.rupoiq (mgr.14195) 113 : cephadm [INF] Deploying daemon osd.5 on smithi005 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: cluster 2024-03-21T13:22:28.143992+0000 mon.smithi005 (mon.0) 463 : cluster [INF] osd.0 [v2:172.21.15.157:6800/597104579,v1:172.21.15.157:6801/597104579] boot 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: cluster 2024-03-21T13:22:28.144110+0000 mon.smithi005 (mon.0) 464 : cluster [DBG] osdmap e16: 8 total, 1 up, 8 in 2024-03-21T13:22:29.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.144304+0000 mon.smithi005 (mon.0) 465 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.144788+0000 mon.smithi005 (mon.0) 466 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.145034+0000 mon.smithi005 (mon.0) 467 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.145271+0000 mon.smithi005 (mon.0) 468 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.145506+0000 mon.smithi005 (mon.0) 469 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.145735+0000 mon.smithi005 (mon.0) 470 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.145973+0000 mon.smithi005 (mon.0) 471 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:29.305 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:28 smithi005 bash[18615]: audit 2024-03-21T13:22:28.146202+0000 mon.smithi005 (mon.0) 472 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: cluster 2024-03-21T13:22:28.444040+0000 mgr.smithi005.rupoiq (mgr.14195) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: cluster 2024-03-21T13:22:29.146450+0000 mon.smithi005 (mon.0) 473 : cluster [DBG] osdmap e17: 8 total, 1 up, 8 in 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.146655+0000 mon.smithi005 (mon.0) 474 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.147301+0000 mon.smithi005 (mon.0) 475 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.147905+0000 mon.smithi005 (mon.0) 476 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.148462+0000 mon.smithi005 (mon.0) 477 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.148990+0000 mon.smithi005 (mon.0) 478 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.149513+0000 mon.smithi005 (mon.0) 479 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.150040+0000 mon.smithi005 (mon.0) 480 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:30.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.288083+0000 mon.smithi005 (mon.0) 481 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.298657+0000 mon.smithi005 (mon.0) 482 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.300856+0000 mon.smithi005 (mon.0) 483 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-21T13:22:30.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:29 smithi157 bash[23502]: audit 2024-03-21T13:22:29.302642+0000 mon.smithi005 (mon.0) 484 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:30.241 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: cluster 2024-03-21T13:22:28.444040+0000 mgr.smithi005.rupoiq (mgr.14195) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: cluster 2024-03-21T13:22:29.146450+0000 mon.smithi005 (mon.0) 473 : cluster [DBG] osdmap e17: 8 total, 1 up, 8 in 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.146655+0000 mon.smithi005 (mon.0) 474 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.147301+0000 mon.smithi005 (mon.0) 475 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.147905+0000 mon.smithi005 (mon.0) 476 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.148462+0000 mon.smithi005 (mon.0) 477 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:30.255 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.148990+0000 mon.smithi005 (mon.0) 478 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.149513+0000 mon.smithi005 (mon.0) 479 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.150040+0000 mon.smithi005 (mon.0) 480 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.288083+0000 mon.smithi005 (mon.0) 481 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.298657+0000 mon.smithi005 (mon.0) 482 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.300856+0000 mon.smithi005 (mon.0) 483 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-21T13:22:30.256 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:29 smithi005 bash[18615]: audit 2024-03-21T13:22:29.302642+0000 mon.smithi005 (mon.0) 484 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:30.972 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:30 smithi005 bash[18615]: cephadm 2024-03-21T13:22:29.304418+0000 mgr.smithi005.rupoiq (mgr.14195) 115 : cephadm [INF] Deploying daemon osd.6 on smithi157 2024-03-21T13:22:30.972 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:30 smithi005 bash[18615]: audit 2024-03-21T13:22:30.028686+0000 mon.smithi005 (mon.0) 485 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-21T13:22:30.972 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:30 smithi005 bash[18615]: audit 2024-03-21T13:22:30.242848+0000 mon.smithi005 (mon.0) 486 : audit [DBG] from='client.? 172.21.15.5:0/4144107512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:31.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:30 smithi157 bash[23502]: cephadm 2024-03-21T13:22:29.304418+0000 mgr.smithi005.rupoiq (mgr.14195) 115 : cephadm [INF] Deploying daemon osd.6 on smithi157 2024-03-21T13:22:31.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:30 smithi157 bash[23502]: audit 2024-03-21T13:22:30.028686+0000 mon.smithi005 (mon.0) 485 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-21T13:22:31.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:30 smithi157 bash[23502]: audit 2024-03-21T13:22:30.242848+0000 mon.smithi005 (mon.0) 486 : audit [DBG] from='client.? 172.21.15.5:0/4144107512' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:31.860 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"num_osds":8,"num_up_osds":1,"osd_up_since":1711027348,"num_in_osds":8,"osd_in_since":1711027321,"num_remapped_pgs":0} 2024-03-21T13:22:31.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: cluster 2024-03-21T13:22:30.444418+0000 mgr.smithi005.rupoiq (mgr.14195) 116 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-21T13:22:31.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.823904+0000 mon.smithi005 (mon.0) 487 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-21T13:22:31.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: cluster 2024-03-21T13:22:30.829349+0000 mon.smithi005 (mon.0) 488 : cluster [DBG] osdmap e18: 8 total, 1 up, 8 in 2024-03-21T13:22:31.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.829968+0000 mon.smithi005 (mon.0) 489 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:31.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.830569+0000 mon.smithi005 (mon.0) 490 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.831098+0000 mon.smithi005 (mon.0) 491 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.831548+0000 mon.smithi005 (mon.0) 492 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.831978+0000 mon.smithi005 (mon.0) 493 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.832473+0000 mon.smithi005 (mon.0) 494 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.832984+0000 mon.smithi005 (mon.0) 495 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:30.833424+0000 mon.smithi005 (mon.0) 496 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:31.317257+0000 mon.smithi157 (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-21T13:22:31.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:31 smithi005 bash[18615]: audit 2024-03-21T13:22:31.318049+0000 mon.smithi005 (mon.0) 497 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-21T13:22:32.022 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: cluster 2024-03-21T13:22:30.444418+0000 mgr.smithi005.rupoiq (mgr.14195) 116 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-21T13:22:32.022 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.823904+0000 mon.smithi005 (mon.0) 487 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: cluster 2024-03-21T13:22:30.829349+0000 mon.smithi005 (mon.0) 488 : cluster [DBG] osdmap e18: 8 total, 1 up, 8 in 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.829968+0000 mon.smithi005 (mon.0) 489 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.830569+0000 mon.smithi005 (mon.0) 490 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.831098+0000 mon.smithi005 (mon.0) 491 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.831548+0000 mon.smithi005 (mon.0) 492 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.831978+0000 mon.smithi005 (mon.0) 493 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.832473+0000 mon.smithi005 (mon.0) 494 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:32.023 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.832984+0000 mon.smithi005 (mon.0) 495 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:32.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:30.833424+0000 mon.smithi005 (mon.0) 496 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:32.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:31.317257+0000 mon.smithi157 (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-21T13:22:32.024 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:31 smithi157 bash[23502]: audit 2024-03-21T13:22:31.318049+0000 mon.smithi005 (mon.0) 497 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-21T13:22:32.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:22:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.826274+0000 mon.smithi005 (mon.0) 498 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.826453+0000 mon.smithi005 (mon.0) 499 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-21T13:22:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: cluster 2024-03-21T13:22:31.831341+0000 mon.smithi005 (mon.0) 500 : cluster [DBG] osdmap e19: 8 total, 1 up, 8 in 2024-03-21T13:22:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.831764+0000 mon.smithi157 (mon.1) 13 : audit [INF] from='osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:33.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.832568+0000 mon.smithi005 (mon.0) 501 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.832851+0000 mon.smithi005 (mon.0) 502 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.833224+0000 mon.smithi005 (mon.0) 503 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.833480+0000 mon.smithi005 (mon.0) 504 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.833759+0000 mon.smithi005 (mon.0) 505 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.834008+0000 mon.smithi005 (mon.0) 506 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.834252+0000 mon.smithi005 (mon.0) 507 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.834507+0000 mon.smithi005 (mon.0) 508 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:31.843111+0000 mon.smithi005 (mon.0) 509 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.145944+0000 mon.smithi005 (mon.0) 510 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.828098+0000 mon.smithi005 (mon.0) 511 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: cluster 2024-03-21T13:22:32.832256+0000 mon.smithi005 (mon.0) 512 : cluster [INF] osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749] boot 2024-03-21T13:22:33.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: cluster 2024-03-21T13:22:32.832340+0000 mon.smithi005 (mon.0) 513 : cluster [DBG] osdmap e20: 8 total, 2 up, 8 in 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.832785+0000 mon.smithi005 (mon.0) 514 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.833133+0000 mon.smithi005 (mon.0) 515 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.833466+0000 mon.smithi005 (mon.0) 516 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.833938+0000 mon.smithi005 (mon.0) 517 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.834245+0000 mon.smithi005 (mon.0) 518 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.834525+0000 mon.smithi005 (mon.0) 519 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:33.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:32 smithi157 bash[23502]: audit 2024-03-21T13:22:32.834837+0000 mon.smithi005 (mon.0) 520 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:33.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.826274+0000 mon.smithi005 (mon.0) 498 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:33.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.826453+0000 mon.smithi005 (mon.0) 499 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: cluster 2024-03-21T13:22:31.831341+0000 mon.smithi005 (mon.0) 500 : cluster [DBG] osdmap e19: 8 total, 1 up, 8 in 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.831764+0000 mon.smithi157 (mon.1) 13 : audit [INF] from='osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.832568+0000 mon.smithi005 (mon.0) 501 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.832851+0000 mon.smithi005 (mon.0) 502 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.833224+0000 mon.smithi005 (mon.0) 503 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.833480+0000 mon.smithi005 (mon.0) 504 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.833759+0000 mon.smithi005 (mon.0) 505 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.834008+0000 mon.smithi005 (mon.0) 506 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.834252+0000 mon.smithi005 (mon.0) 507 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.834507+0000 mon.smithi005 (mon.0) 508 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:33.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:31.843111+0000 mon.smithi005 (mon.0) 509 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.145944+0000 mon.smithi005 (mon.0) 510 : audit [INF] from='osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749]' entity='osd.1' 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.828098+0000 mon.smithi005 (mon.0) 511 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: cluster 2024-03-21T13:22:32.832256+0000 mon.smithi005 (mon.0) 512 : cluster [INF] osd.1 [v2:172.21.15.5:6802/3365736749,v1:172.21.15.5:6803/3365736749] boot 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: cluster 2024-03-21T13:22:32.832340+0000 mon.smithi005 (mon.0) 513 : cluster [DBG] osdmap e20: 8 total, 2 up, 8 in 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.832785+0000 mon.smithi005 (mon.0) 514 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.833133+0000 mon.smithi005 (mon.0) 515 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.833466+0000 mon.smithi005 (mon.0) 516 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.833938+0000 mon.smithi005 (mon.0) 517 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.834245+0000 mon.smithi005 (mon.0) 518 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.834525+0000 mon.smithi005 (mon.0) 519 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:33.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:32 smithi005 bash[18615]: audit 2024-03-21T13:22:32.834837+0000 mon.smithi005 (mon.0) 520 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:34.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:33 smithi005 bash[18615]: cluster 2024-03-21T13:22:31.027105+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:34.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:33 smithi005 bash[18615]: cluster 2024-03-21T13:22:31.027179+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:34.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:33 smithi005 bash[18615]: cluster 2024-03-21T13:22:32.444871+0000 mgr.smithi005.rupoiq (mgr.14195) 117 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-21T13:22:34.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:33 smithi005 bash[18615]: audit 2024-03-21T13:22:32.843107+0000 mon.smithi005 (mon.0) 521 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:34.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:33 smithi157 bash[23502]: cluster 2024-03-21T13:22:31.027105+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:34.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:33 smithi157 bash[23502]: cluster 2024-03-21T13:22:31.027179+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:34.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:33 smithi157 bash[23502]: cluster 2024-03-21T13:22:32.444871+0000 mgr.smithi005.rupoiq (mgr.14195) 117 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-21T13:22:34.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:33 smithi157 bash[23502]: audit 2024-03-21T13:22:32.843107+0000 mon.smithi005 (mon.0) 521 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:34.353 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:34 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:34.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:34 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:34 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: cluster 2024-03-21T13:22:32.332951+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: cluster 2024-03-21T13:22:32.333398+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: cluster 2024-03-21T13:22:33.844997+0000 mon.smithi005 (mon.0) 522 : cluster [INF] osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729] boot 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: cluster 2024-03-21T13:22:33.845086+0000 mon.smithi005 (mon.0) 523 : cluster [DBG] osdmap e21: 8 total, 3 up, 8 in 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.845634+0000 mon.smithi005 (mon.0) 524 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.846516+0000 mon.smithi005 (mon.0) 525 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.851925+0000 mon.smithi005 (mon.0) 526 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.852297+0000 mon.smithi005 (mon.0) 527 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.852625+0000 mon.smithi005 (mon.0) 528 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:35.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 bash[23502]: audit 2024-03-21T13:22:33.852942+0000 mon.smithi005 (mon.0) 529 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:35.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: cluster 2024-03-21T13:22:32.332951+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: cluster 2024-03-21T13:22:32.333398+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: cluster 2024-03-21T13:22:33.844997+0000 mon.smithi005 (mon.0) 522 : cluster [INF] osd.2 [v2:172.21.15.157:6808/2024070729,v1:172.21.15.157:6809/2024070729] boot 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: cluster 2024-03-21T13:22:33.845086+0000 mon.smithi005 (mon.0) 523 : cluster [DBG] osdmap e21: 8 total, 3 up, 8 in 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.845634+0000 mon.smithi005 (mon.0) 524 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.846516+0000 mon.smithi005 (mon.0) 525 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.851925+0000 mon.smithi005 (mon.0) 526 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.852297+0000 mon.smithi005 (mon.0) 527 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.852625+0000 mon.smithi005 (mon.0) 528 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:35.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:35 smithi005 bash[18615]: audit 2024-03-21T13:22:33.852942+0000 mon.smithi005 (mon.0) 529 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:35.347 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:35 smithi157 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: cluster 2024-03-21T13:22:34.445327+0000 mgr.smithi005.rupoiq (mgr.14195) 118 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 457 MiB used, 178 GiB / 179 GiB avail 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:34.556135+0000 mon.smithi005 (mon.0) 530 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.028116+0000 mon.smithi005 (mon.0) 531 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.031363+0000 mon.smithi005 (mon.0) 532 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: cluster 2024-03-21T13:22:35.031847+0000 mon.smithi005 (mon.0) 533 : cluster [DBG] osdmap e22: 8 total, 3 up, 8 in 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.032961+0000 mon.smithi005 (mon.0) 534 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:36.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.033473+0000 mon.smithi005 (mon.0) 535 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.034013+0000 mon.smithi005 (mon.0) 536 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.034413+0000 mon.smithi005 (mon.0) 537 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.034954+0000 mon.smithi005 (mon.0) 538 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.038442+0000 mon.smithi005 (mon.0) 539 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.041388+0000 mon.smithi005 (mon.0) 540 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.042677+0000 mon.smithi005 (mon.0) 541 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.043669+0000 mon.smithi005 (mon.0) 542 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: cephadm 2024-03-21T13:22:35.044597+0000 mgr.smithi005.rupoiq (mgr.14195) 119 : cephadm [INF] Deploying daemon osd.7 on smithi005 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.394836+0000 mon.smithi005 (mon.0) 543 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:36 smithi157 bash[23502]: audit 2024-03-21T13:22:35.404084+0000 mon.smithi005 (mon.0) 544 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: cluster 2024-03-21T13:22:34.445327+0000 mgr.smithi005.rupoiq (mgr.14195) 118 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 457 MiB used, 178 GiB / 179 GiB avail 2024-03-21T13:22:36.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:34.556135+0000 mon.smithi005 (mon.0) 530 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:22:36.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.028116+0000 mon.smithi005 (mon.0) 531 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.031363+0000 mon.smithi005 (mon.0) 532 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: cluster 2024-03-21T13:22:35.031847+0000 mon.smithi005 (mon.0) 533 : cluster [DBG] osdmap e22: 8 total, 3 up, 8 in 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.032961+0000 mon.smithi005 (mon.0) 534 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.033473+0000 mon.smithi005 (mon.0) 535 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.034013+0000 mon.smithi005 (mon.0) 536 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.034413+0000 mon.smithi005 (mon.0) 537 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.034954+0000 mon.smithi005 (mon.0) 538 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.038442+0000 mon.smithi005 (mon.0) 539 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.041388+0000 mon.smithi005 (mon.0) 540 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.042677+0000 mon.smithi005 (mon.0) 541 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.043669+0000 mon.smithi005 (mon.0) 542 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: cephadm 2024-03-21T13:22:35.044597+0000 mgr.smithi005.rupoiq (mgr.14195) 119 : cephadm [INF] Deploying daemon osd.7 on smithi005 2024-03-21T13:22:36.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.394836+0000 mon.smithi005 (mon.0) 543 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:36.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:36 smithi005 bash[18615]: audit 2024-03-21T13:22:35.404084+0000 mon.smithi005 (mon.0) 544 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.035437+0000 mon.smithi005 (mon.0) 545 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: cluster 2024-03-21T13:22:36.038772+0000 mon.smithi005 (mon.0) 546 : cluster [DBG] osdmap e23: 8 total, 3 up, 8 in 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.039375+0000 mon.smithi005 (mon.0) 547 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.039729+0000 mon.smithi005 (mon.0) 548 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.040048+0000 mon.smithi005 (mon.0) 549 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.040374+0000 mon.smithi005 (mon.0) 550 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:37.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.040679+0000 mon.smithi005 (mon.0) 551 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:37.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: cluster 2024-03-21T13:22:36.445660+0000 mgr.smithi005.rupoiq (mgr.14195) 120 : cluster [DBG] pgmap v77: 1 pgs: 1 unknown; 0 B data, 484 MiB used, 268 GiB / 268 GiB avail 2024-03-21T13:22:37.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:37 smithi005 bash[18615]: audit 2024-03-21T13:22:36.808709+0000 mon.smithi005 (mon.0) 552 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-21T13:22:37.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.035437+0000 mon.smithi005 (mon.0) 545 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: cluster 2024-03-21T13:22:36.038772+0000 mon.smithi005 (mon.0) 546 : cluster [DBG] osdmap e23: 8 total, 3 up, 8 in 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.039375+0000 mon.smithi005 (mon.0) 547 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.039729+0000 mon.smithi005 (mon.0) 548 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.040048+0000 mon.smithi005 (mon.0) 549 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.040374+0000 mon.smithi005 (mon.0) 550 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.040679+0000 mon.smithi005 (mon.0) 551 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: cluster 2024-03-21T13:22:36.445660+0000 mgr.smithi005.rupoiq (mgr.14195) 120 : cluster [DBG] pgmap v77: 1 pgs: 1 unknown; 0 B data, 484 MiB used, 268 GiB / 268 GiB avail 2024-03-21T13:22:37.370 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:37 smithi157 bash[23502]: audit 2024-03-21T13:22:36.808709+0000 mon.smithi005 (mon.0) 552 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-21T13:22:38.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.043567+0000 mon.smithi005 (mon.0) 553 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: cluster 2024-03-21T13:22:37.050435+0000 mon.smithi005 (mon.0) 554 : cluster [DBG] osdmap e24: 8 total, 3 up, 8 in 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.051173+0000 mon.smithi005 (mon.0) 555 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.051751+0000 mon.smithi005 (mon.0) 556 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.052314+0000 mon.smithi005 (mon.0) 557 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.052853+0000 mon.smithi005 (mon.0) 558 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.053423+0000 mon.smithi005 (mon.0) 559 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.053998+0000 mon.smithi005 (mon.0) 560 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.168251+0000 mon.smithi005 (mon.0) 561 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.537360+0000 mon.smithi157 (mon.1) 14 : audit [INF] from='osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-21T13:22:38.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:38 smithi005 bash[18615]: audit 2024-03-21T13:22:37.537998+0000 mon.smithi005 (mon.0) 562 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.043567+0000 mon.smithi005 (mon.0) 553 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: cluster 2024-03-21T13:22:37.050435+0000 mon.smithi005 (mon.0) 554 : cluster [DBG] osdmap e24: 8 total, 3 up, 8 in 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.051173+0000 mon.smithi005 (mon.0) 555 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.051751+0000 mon.smithi005 (mon.0) 556 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.052314+0000 mon.smithi005 (mon.0) 557 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.052853+0000 mon.smithi005 (mon.0) 558 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.053423+0000 mon.smithi005 (mon.0) 559 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.053998+0000 mon.smithi005 (mon.0) 560 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.168251+0000 mon.smithi005 (mon.0) 561 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.537360+0000 mon.smithi157 (mon.1) 14 : audit [INF] from='osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-21T13:22:38.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:38 smithi157 bash[23502]: audit 2024-03-21T13:22:37.537998+0000 mon.smithi005 (mon.0) 562 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-21T13:22:38.375 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.045024+0000 mon.smithi005 (mon.0) 563 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.045087+0000 mon.smithi005 (mon.0) 564 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.047668+0000 mon.smithi005 (mon.0) 565 : cluster [DBG] osdmap e25: 8 total, 3 up, 8 in 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.049034+0000 mon.smithi005 (mon.0) 566 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.049670+0000 mon.smithi005 (mon.0) 567 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.050293+0000 mon.smithi005 (mon.0) 568 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.050765+0000 mon.smithi005 (mon.0) 569 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.051273+0000 mon.smithi005 (mon.0) 570 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.052349+0000 mon.smithi157 (mon.1) 15 : audit [INF] from='osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:39.408 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.057967+0000 mon.smithi005 (mon.0) 571 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.060011+0000 mon.smithi005 (mon.0) 572 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.174476+0000 mon.smithi005 (mon.0) 573 : cluster [DBG] mgrmap e19: smithi005.rupoiq(active, since 2m), standbys: smithi157.xdzklg 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.446163+0000 mgr.smithi005.rupoiq (mgr.14195) 121 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.839829+0000 mon.smithi005 (mon.0) 574 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.844608+0000 mon.smithi005 (mon.0) 575 : cluster [INF] osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152] boot 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.844682+0000 mon.smithi005 (mon.0) 576 : cluster [DBG] osdmap e26: 8 total, 4 up, 8 in 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.845275+0000 mon.smithi005 (mon.0) 577 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.845709+0000 mon.smithi005 (mon.0) 578 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.846070+0000 mon.smithi005 (mon.0) 579 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.846411+0000 mon.smithi005 (mon.0) 580 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.846717+0000 mon.smithi005 (mon.0) 581 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:39.409 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:39 smithi157 bash[23502]: audit 2024-03-21T13:22:38.849004+0000 mon.smithi005 (mon.0) 582 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:39.413 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.045024+0000 mon.smithi005 (mon.0) 563 : audit [INF] from='osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:39.413 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.045087+0000 mon.smithi005 (mon.0) 564 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-21T13:22:39.413 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.047668+0000 mon.smithi005 (mon.0) 565 : cluster [DBG] osdmap e25: 8 total, 3 up, 8 in 2024-03-21T13:22:39.413 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.049034+0000 mon.smithi005 (mon.0) 566 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.049670+0000 mon.smithi005 (mon.0) 567 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.050293+0000 mon.smithi005 (mon.0) 568 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.050765+0000 mon.smithi005 (mon.0) 569 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.051273+0000 mon.smithi005 (mon.0) 570 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.052349+0000 mon.smithi157 (mon.1) 15 : audit [INF] from='osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.057967+0000 mon.smithi005 (mon.0) 571 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.060011+0000 mon.smithi005 (mon.0) 572 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.174476+0000 mon.smithi005 (mon.0) 573 : cluster [DBG] mgrmap e19: smithi005.rupoiq(active, since 2m), standbys: smithi157.xdzklg 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.446163+0000 mgr.smithi005.rupoiq (mgr.14195) 121 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.839829+0000 mon.smithi005 (mon.0) 574 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.844608+0000 mon.smithi005 (mon.0) 575 : cluster [INF] osd.3 [v2:172.21.15.5:6810/3158278152,v1:172.21.15.5:6811/3158278152] boot 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.844682+0000 mon.smithi005 (mon.0) 576 : cluster [DBG] osdmap e26: 8 total, 4 up, 8 in 2024-03-21T13:22:39.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.845275+0000 mon.smithi005 (mon.0) 577 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-21T13:22:39.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.845709+0000 mon.smithi005 (mon.0) 578 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:39.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.846070+0000 mon.smithi005 (mon.0) 579 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:39.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.846411+0000 mon.smithi005 (mon.0) 580 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:39.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.846717+0000 mon.smithi005 (mon.0) 581 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:39.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:39 smithi005 bash[18615]: audit 2024-03-21T13:22:38.849004+0000 mon.smithi005 (mon.0) 582 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: cluster 2024-03-21T13:22:37.817607+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: cluster 2024-03-21T13:22:37.817726+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: audit 2024-03-21T13:22:39.499046+0000 mon.smithi005 (mon.0) 583 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: cluster 2024-03-21T13:22:39.845141+0000 mon.smithi005 (mon.0) 584 : cluster [INF] osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995] boot 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: cluster 2024-03-21T13:22:39.845195+0000 mon.smithi005 (mon.0) 585 : cluster [DBG] osdmap e27: 8 total, 5 up, 8 in 2024-03-21T13:22:40.221 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: audit 2024-03-21T13:22:39.845325+0000 mon.smithi005 (mon.0) 586 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:40.222 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: audit 2024-03-21T13:22:39.845912+0000 mon.smithi005 (mon.0) 587 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:40.222 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: audit 2024-03-21T13:22:39.846157+0000 mon.smithi005 (mon.0) 588 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:40.222 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:40 smithi005 bash[18615]: audit 2024-03-21T13:22:39.846412+0000 mon.smithi005 (mon.0) 589 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: cluster 2024-03-21T13:22:37.817607+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: cluster 2024-03-21T13:22:37.817726+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: audit 2024-03-21T13:22:39.499046+0000 mon.smithi005 (mon.0) 583 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: cluster 2024-03-21T13:22:39.845141+0000 mon.smithi005 (mon.0) 584 : cluster [INF] osd.4 [v2:172.21.15.157:6816/2088490995,v1:172.21.15.157:6817/2088490995] boot 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: cluster 2024-03-21T13:22:39.845195+0000 mon.smithi005 (mon.0) 585 : cluster [DBG] osdmap e27: 8 total, 5 up, 8 in 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: audit 2024-03-21T13:22:39.845325+0000 mon.smithi005 (mon.0) 586 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: audit 2024-03-21T13:22:39.845912+0000 mon.smithi005 (mon.0) 587 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:40.427 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: audit 2024-03-21T13:22:39.846157+0000 mon.smithi005 (mon.0) 588 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:40.428 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:40 smithi157 bash[23502]: audit 2024-03-21T13:22:39.846412+0000 mon.smithi005 (mon.0) 589 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:41.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.584321+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:41.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: cluster 2024-03-21T13:22:38.584450+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:41.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: cluster 2024-03-21T13:22:40.446753+0000 mgr.smithi005.rupoiq (mgr.14195) 122 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail 2024-03-21T13:22:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: cluster 2024-03-21T13:22:40.849250+0000 mon.smithi005 (mon.0) 590 : cluster [DBG] osdmap e28: 8 total, 5 up, 8 in 2024-03-21T13:22:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: audit 2024-03-21T13:22:40.849511+0000 mon.smithi005 (mon.0) 591 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: audit 2024-03-21T13:22:40.850276+0000 mon.smithi005 (mon.0) 592 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: audit 2024-03-21T13:22:40.850801+0000 mon.smithi005 (mon.0) 593 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:41.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 bash[18615]: audit 2024-03-21T13:22:40.910567+0000 mon.smithi005 (mon.0) 594 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:41.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.584321+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:41.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: cluster 2024-03-21T13:22:38.584450+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:41.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: cluster 2024-03-21T13:22:40.446753+0000 mgr.smithi005.rupoiq (mgr.14195) 122 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail 2024-03-21T13:22:41.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: cluster 2024-03-21T13:22:40.849250+0000 mon.smithi005 (mon.0) 590 : cluster [DBG] osdmap e28: 8 total, 5 up, 8 in 2024-03-21T13:22:41.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: audit 2024-03-21T13:22:40.849511+0000 mon.smithi005 (mon.0) 591 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:41.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: audit 2024-03-21T13:22:40.850276+0000 mon.smithi005 (mon.0) 592 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:41.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: audit 2024-03-21T13:22:40.850801+0000 mon.smithi005 (mon.0) 593 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:41.543 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:41 smithi157 bash[23502]: audit 2024-03-21T13:22:40.910567+0000 mon.smithi005 (mon.0) 594 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:41.933 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:41 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:42.219 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:22:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:22:43.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:41.831743+0000 mon.smithi005 (mon.0) 595 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.280080+0000 mon.smithi005 (mon.0) 596 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.286210+0000 mon.smithi005 (mon.0) 597 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.414094+0000 mon.smithi157 (mon.1) 16 : audit [INF] from='osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-21T13:22:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.414517+0000 mon.smithi005 (mon.0) 598 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-21T13:22:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.775976+0000 mon.smithi005 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.5:0/3452692450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:43.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:42 smithi157 bash[23502]: audit 2024-03-21T13:22:42.813817+0000 mon.smithi005 (mon.0) 600 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:41.831743+0000 mon.smithi005 (mon.0) 595 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.280080+0000 mon.smithi005 (mon.0) 596 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.286210+0000 mon.smithi005 (mon.0) 597 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.414094+0000 mon.smithi157 (mon.1) 16 : audit [INF] from='osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.414517+0000 mon.smithi005 (mon.0) 598 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.775976+0000 mon.smithi005 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.5:0/3452692450' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:43.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:42 smithi005 bash[18615]: audit 2024-03-21T13:22:42.813817+0000 mon.smithi005 (mon.0) 600 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:43.904 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":28,"num_osds":8,"num_up_osds":5,"osd_up_since":1711027359,"num_in_osds":8,"osd_in_since":1711027321,"num_remapped_pgs":0} 2024-03-21T13:22:44.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd stat -f json 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: cluster 2024-03-21T13:22:42.447089+0000 mgr.smithi005.rupoiq (mgr.14195) 123 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.088719+0000 mon.smithi005 (mon.0) 601 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.291493+0000 mon.smithi005 (mon.0) 602 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.291787+0000 mon.smithi005 (mon.0) 603 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: cluster 2024-03-21T13:22:43.296745+0000 mon.smithi005 (mon.0) 604 : cluster [DBG] osdmap e29: 8 total, 5 up, 8 in 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.296805+0000 mon.smithi157 (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.297711+0000 mon.smithi005 (mon.0) 605 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.298857+0000 mon.smithi005 (mon.0) 606 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.299857+0000 mon.smithi005 (mon.0) 607 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.300700+0000 mon.smithi005 (mon.0) 608 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.301360+0000 mon.smithi005 (mon.0) 609 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.786182+0000 mon.smithi005 (mon.0) 610 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:45.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:44 smithi157 bash[23502]: audit 2024-03-21T13:22:43.791365+0000 mon.smithi005 (mon.0) 611 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-21T13:22:45.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: cluster 2024-03-21T13:22:42.447089+0000 mgr.smithi005.rupoiq (mgr.14195) 123 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.088719+0000 mon.smithi005 (mon.0) 601 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.291493+0000 mon.smithi005 (mon.0) 602 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.291787+0000 mon.smithi005 (mon.0) 603 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: cluster 2024-03-21T13:22:43.296745+0000 mon.smithi005 (mon.0) 604 : cluster [DBG] osdmap e29: 8 total, 5 up, 8 in 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.296805+0000 mon.smithi157 (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.297711+0000 mon.smithi005 (mon.0) 605 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.298857+0000 mon.smithi005 (mon.0) 606 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.299857+0000 mon.smithi005 (mon.0) 607 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.300700+0000 mon.smithi005 (mon.0) 608 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.301360+0000 mon.smithi005 (mon.0) 609 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.786182+0000 mon.smithi005 (mon.0) 610 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:45.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:44 smithi005 bash[18615]: audit 2024-03-21T13:22:43.791365+0000 mon.smithi005 (mon.0) 611 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-21T13:22:46.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: cluster 2024-03-21T13:22:43.442286+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:46.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: cluster 2024-03-21T13:22:43.442405+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:46.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: cluster 2024-03-21T13:22:44.447463+0000 mgr.smithi005.rupoiq (mgr.14195) 124 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail; 4.8 KiB/s rd, 279 KiB/s wr, 17 op/s; 103 KiB/s, 0 objects/s recovering 2024-03-21T13:22:46.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.729570+0000 mon.smithi005 (mon.0) 612 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.731376+0000 mon.smithi005 (mon.0) 613 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.735357+0000 mon.smithi005 (mon.0) 614 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.735880+0000 mon.smithi005 (mon.0) 615 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.735936+0000 mon.smithi005 (mon.0) 616 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: cluster 2024-03-21T13:22:44.738193+0000 mon.smithi005 (mon.0) 617 : cluster [DBG] osdmap e30: 8 total, 5 up, 8 in 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.738909+0000 mon.smithi005 (mon.0) 618 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.739160+0000 mon.smithi005 (mon.0) 619 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.739371+0000 mon.smithi005 (mon.0) 620 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.741835+0000 mon.smithi005 (mon.0) 621 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.743535+0000 mon.smithi005 (mon.0) 622 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.759888+0000 mon.smithi005 (mon.0) 623 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.761412+0000 mon.smithi157 (mon.1) 18 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-21T13:22:46.044 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.761545+0000 mon.smithi005 (mon.0) 624 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:22:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:44.761708+0000 mon.smithi005 (mon.0) 625 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:22:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:45.652121+0000 mon.smithi157 (mon.1) 19 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-21T13:22:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:45.655759+0000 mon.smithi005 (mon.0) 626 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:45.661868+0000 mon.smithi005 (mon.0) 627 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.045 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:45 smithi157 bash[23502]: audit 2024-03-21T13:22:45.675661+0000 mon.smithi005 (mon.0) 628 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: cluster 2024-03-21T13:22:43.442286+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: cluster 2024-03-21T13:22:43.442405+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: cluster 2024-03-21T13:22:44.447463+0000 mgr.smithi005.rupoiq (mgr.14195) 124 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail; 4.8 KiB/s rd, 279 KiB/s wr, 17 op/s; 103 KiB/s, 0 objects/s recovering 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.729570+0000 mon.smithi005 (mon.0) 612 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.731376+0000 mon.smithi005 (mon.0) 613 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:22:46.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.735357+0000 mon.smithi005 (mon.0) 614 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.735880+0000 mon.smithi005 (mon.0) 615 : audit [INF] from='osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.735936+0000 mon.smithi005 (mon.0) 616 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: cluster 2024-03-21T13:22:44.738193+0000 mon.smithi005 (mon.0) 617 : cluster [DBG] osdmap e30: 8 total, 5 up, 8 in 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.738909+0000 mon.smithi005 (mon.0) 618 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.739160+0000 mon.smithi005 (mon.0) 619 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.739371+0000 mon.smithi005 (mon.0) 620 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.741835+0000 mon.smithi005 (mon.0) 621 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.743535+0000 mon.smithi005 (mon.0) 622 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.759888+0000 mon.smithi005 (mon.0) 623 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.761412+0000 mon.smithi157 (mon.1) 18 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.761545+0000 mon.smithi005 (mon.0) 624 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:44.761708+0000 mon.smithi005 (mon.0) 625 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:45.652121+0000 mon.smithi157 (mon.1) 19 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-21T13:22:46.054 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:45.655759+0000 mon.smithi005 (mon.0) 626 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.055 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:45.661868+0000 mon.smithi005 (mon.0) 627 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.055 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:45 smithi005 bash[18615]: audit 2024-03-21T13:22:45.675661+0000 mon.smithi005 (mon.0) 628 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: cluster 2024-03-21T13:22:44.134371+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: cluster 2024-03-21T13:22:44.134481+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: audit 2024-03-21T13:22:45.749008+0000 mon.smithi005 (mon.0) 629 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: audit 2024-03-21T13:22:45.749627+0000 mon.smithi005 (mon.0) 630 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: cluster 2024-03-21T13:22:45.765547+0000 mon.smithi005 (mon.0) 631 : cluster [INF] osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884] boot 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: cluster 2024-03-21T13:22:45.765677+0000 mon.smithi005 (mon.0) 632 : cluster [INF] osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186] boot 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: cluster 2024-03-21T13:22:45.765785+0000 mon.smithi005 (mon.0) 633 : cluster [DBG] osdmap e31: 8 total, 7 up, 8 in 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: audit 2024-03-21T13:22:45.766053+0000 mon.smithi005 (mon.0) 634 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: audit 2024-03-21T13:22:45.766702+0000 mon.smithi005 (mon.0) 635 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:46.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:46 smithi005 bash[18615]: audit 2024-03-21T13:22:45.767181+0000 mon.smithi005 (mon.0) 636 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: cluster 2024-03-21T13:22:44.134371+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: cluster 2024-03-21T13:22:44.134481+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: audit 2024-03-21T13:22:45.749008+0000 mon.smithi005 (mon.0) 629 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: audit 2024-03-21T13:22:45.749627+0000 mon.smithi005 (mon.0) 630 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: cluster 2024-03-21T13:22:45.765547+0000 mon.smithi005 (mon.0) 631 : cluster [INF] osd.5 [v2:172.21.15.5:6818/1563956884,v1:172.21.15.5:6819/1563956884] boot 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: cluster 2024-03-21T13:22:45.765677+0000 mon.smithi005 (mon.0) 632 : cluster [INF] osd.6 [v2:172.21.15.157:6824/3915520186,v1:172.21.15.157:6825/3915520186] boot 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: cluster 2024-03-21T13:22:45.765785+0000 mon.smithi005 (mon.0) 633 : cluster [DBG] osdmap e31: 8 total, 7 up, 8 in 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: audit 2024-03-21T13:22:45.766053+0000 mon.smithi005 (mon.0) 634 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: audit 2024-03-21T13:22:45.766702+0000 mon.smithi005 (mon.0) 635 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-21T13:22:47.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:46 smithi157 bash[23502]: audit 2024-03-21T13:22:45.767181+0000 mon.smithi005 (mon.0) 636 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:48.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:47 smithi157 bash[23502]: cluster 2024-03-21T13:22:46.448193+0000 mgr.smithi005.rupoiq (mgr.14195) 125 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 4.8 KiB/s rd, 280 KiB/s wr, 17 op/s; 103 KiB/s, 0 objects/s recovering 2024-03-21T13:22:48.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:47 smithi157 bash[23502]: cluster 2024-03-21T13:22:46.772314+0000 mon.smithi005 (mon.0) 637 : cluster [DBG] osdmap e32: 8 total, 7 up, 8 in 2024-03-21T13:22:48.043 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:47 smithi157 bash[23502]: audit 2024-03-21T13:22:46.772581+0000 mon.smithi005 (mon.0) 638 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:48.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:47 smithi005 bash[18615]: cluster 2024-03-21T13:22:46.448193+0000 mgr.smithi005.rupoiq (mgr.14195) 125 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 144 MiB used, 447 GiB / 447 GiB avail; 4.8 KiB/s rd, 280 KiB/s wr, 17 op/s; 103 KiB/s, 0 objects/s recovering 2024-03-21T13:22:48.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:47 smithi005 bash[18615]: cluster 2024-03-21T13:22:46.772314+0000 mon.smithi005 (mon.0) 637 : cluster [DBG] osdmap e32: 8 total, 7 up, 8 in 2024-03-21T13:22:48.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:47 smithi005 bash[18615]: audit 2024-03-21T13:22:46.772581+0000 mon.smithi005 (mon.0) 638 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:50.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:49 smithi157 bash[23502]: cluster 2024-03-21T13:22:48.448994+0000 mgr.smithi005.rupoiq (mgr.14195) 126 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 7.0 KiB/s rd, 355 KiB/s wr, 23 op/s 2024-03-21T13:22:50.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:49 smithi005 bash[18615]: cluster 2024-03-21T13:22:48.448994+0000 mgr.smithi005.rupoiq (mgr.14195) 126 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 7.0 KiB/s rd, 355 KiB/s wr, 23 op/s 2024-03-21T13:22:51.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:50 smithi157 bash[23502]: audit 2024-03-21T13:22:50.170921+0000 mon.smithi157 (mon.1) 20 : audit [INF] from='osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-21T13:22:51.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:50 smithi157 bash[23502]: audit 2024-03-21T13:22:50.171628+0000 mon.smithi005 (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-21T13:22:51.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:50 smithi005 bash[18615]: audit 2024-03-21T13:22:50.170921+0000 mon.smithi157 (mon.1) 20 : audit [INF] from='osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-21T13:22:51.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:50 smithi005 bash[18615]: audit 2024-03-21T13:22:50.171628+0000 mon.smithi005 (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-21T13:22:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:22:52.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: cluster 2024-03-21T13:22:50.449630+0000 mgr.smithi005.rupoiq (mgr.14195) 127 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 19 op/s 2024-03-21T13:22:52.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: audit 2024-03-21T13:22:50.782894+0000 mon.smithi005 (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-21T13:22:52.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: cluster 2024-03-21T13:22:50.787722+0000 mon.smithi005 (mon.0) 641 : cluster [DBG] osdmap e33: 8 total, 7 up, 8 in 2024-03-21T13:22:52.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: audit 2024-03-21T13:22:50.788291+0000 mon.smithi005 (mon.0) 642 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:52.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: audit 2024-03-21T13:22:50.788778+0000 mon.smithi157 (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:52.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:51 smithi005 bash[18615]: audit 2024-03-21T13:22:50.789516+0000 mon.smithi005 (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:52.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: cluster 2024-03-21T13:22:50.449630+0000 mgr.smithi005.rupoiq (mgr.14195) 127 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 19 op/s 2024-03-21T13:22:52.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: audit 2024-03-21T13:22:50.782894+0000 mon.smithi005 (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-21T13:22:52.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: cluster 2024-03-21T13:22:50.787722+0000 mon.smithi005 (mon.0) 641 : cluster [DBG] osdmap e33: 8 total, 7 up, 8 in 2024-03-21T13:22:52.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: audit 2024-03-21T13:22:50.788291+0000 mon.smithi005 (mon.0) 642 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:52.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: audit 2024-03-21T13:22:50.788778+0000 mon.smithi157 (mon.1) 21 : audit [INF] from='osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:52.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:51 smithi157 bash[23502]: audit 2024-03-21T13:22:50.789516+0000 mon.smithi005 (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-03-21T13:22:53.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: audit 2024-03-21T13:22:51.785703+0000 mon.smithi005 (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: cluster 2024-03-21T13:22:51.791107+0000 mon.smithi005 (mon.0) 645 : cluster [DBG] osdmap e34: 8 total, 7 up, 8 in 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: audit 2024-03-21T13:22:51.792064+0000 mon.smithi005 (mon.0) 646 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: audit 2024-03-21T13:22:51.801022+0000 mon.smithi005 (mon.0) 647 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: cluster 2024-03-21T13:22:52.790725+0000 mon.smithi005 (mon.0) 648 : cluster [INF] osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382] boot 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: cluster 2024-03-21T13:22:52.790984+0000 mon.smithi005 (mon.0) 649 : cluster [DBG] osdmap e35: 8 total, 8 up, 8 in 2024-03-21T13:22:53.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:52 smithi005 bash[18615]: audit 2024-03-21T13:22:52.791160+0000 mon.smithi005 (mon.0) 650 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:53.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: audit 2024-03-21T13:22:51.785703+0000 mon.smithi005 (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: cluster 2024-03-21T13:22:51.791107+0000 mon.smithi005 (mon.0) 645 : cluster [DBG] osdmap e34: 8 total, 7 up, 8 in 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: audit 2024-03-21T13:22:51.792064+0000 mon.smithi005 (mon.0) 646 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: audit 2024-03-21T13:22:51.801022+0000 mon.smithi005 (mon.0) 647 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: cluster 2024-03-21T13:22:52.790725+0000 mon.smithi005 (mon.0) 648 : cluster [INF] osd.7 [v2:172.21.15.5:6826/2191649382,v1:172.21.15.5:6827/2191649382] boot 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: cluster 2024-03-21T13:22:52.790984+0000 mon.smithi005 (mon.0) 649 : cluster [DBG] osdmap e35: 8 total, 8 up, 8 in 2024-03-21T13:22:53.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:52 smithi157 bash[23502]: audit 2024-03-21T13:22:52.791160+0000 mon.smithi005 (mon.0) 650 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-21T13:22:54.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:53 smithi005 bash[18615]: cluster 2024-03-21T13:22:51.133826+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:53 smithi005 bash[18615]: cluster 2024-03-21T13:22:51.133923+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:54.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:53 smithi005 bash[18615]: cluster 2024-03-21T13:22:52.450018+0000 mgr.smithi005.rupoiq (mgr.14195) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 19 op/s 2024-03-21T13:22:54.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:53 smithi157 bash[23502]: cluster 2024-03-21T13:22:51.133826+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-21T13:22:54.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:53 smithi157 bash[23502]: cluster 2024-03-21T13:22:51.133923+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-21T13:22:54.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:53 smithi157 bash[23502]: cluster 2024-03-21T13:22:52.450018+0000 mgr.smithi005.rupoiq (mgr.14195) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 198 MiB used, 626 GiB / 626 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 19 op/s 2024-03-21T13:22:54.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:22:55.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:54 smithi005 bash[18615]: cluster 2024-03-21T13:22:53.803436+0000 mon.smithi005 (mon.0) 651 : cluster [DBG] osdmap e36: 8 total, 8 up, 8 in 2024-03-21T13:22:55.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:54 smithi005 bash[18615]: audit 2024-03-21T13:22:54.312079+0000 mon.smithi005 (mon.0) 652 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:55.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:54 smithi005 bash[18615]: audit 2024-03-21T13:22:54.319750+0000 mon.smithi005 (mon.0) 653 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:55.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:54 smithi005 bash[18615]: audit 2024-03-21T13:22:54.414667+0000 mon.smithi005 (mon.0) 654 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:22:55.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:54 smithi005 bash[18615]: audit 2024-03-21T13:22:54.500178+0000 mon.smithi005 (mon.0) 655 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:55.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:54 smithi157 bash[23502]: cluster 2024-03-21T13:22:53.803436+0000 mon.smithi005 (mon.0) 651 : cluster [DBG] osdmap e36: 8 total, 8 up, 8 in 2024-03-21T13:22:55.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:54 smithi157 bash[23502]: audit 2024-03-21T13:22:54.312079+0000 mon.smithi005 (mon.0) 652 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:55.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:54 smithi157 bash[23502]: audit 2024-03-21T13:22:54.319750+0000 mon.smithi005 (mon.0) 653 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:22:55.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:54 smithi157 bash[23502]: audit 2024-03-21T13:22:54.414667+0000 mon.smithi005 (mon.0) 654 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:22:55.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:54 smithi157 bash[23502]: audit 2024-03-21T13:22:54.500178+0000 mon.smithi005 (mon.0) 655 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:22:55.686 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1711027372,"num_in_osds":8,"osd_in_since":1711027321,"num_remapped_pgs":1} 2024-03-21T13:22:55.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-21T13:22:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:55 smithi005 bash[18615]: cluster 2024-03-21T13:22:54.450464+0000 mgr.smithi005.rupoiq (mgr.14195) 129 : cluster [DBG] pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:22:56.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:55 smithi005 bash[18615]: cluster 2024-03-21T13:22:54.817598+0000 mon.smithi005 (mon.0) 656 : cluster [DBG] osdmap e37: 8 total, 8 up, 8 in 2024-03-21T13:22:56.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:55 smithi005 bash[18615]: audit 2024-03-21T13:22:54.940623+0000 mon.smithi005 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.5:0/4149600656' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:56.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:55 smithi157 bash[23502]: cluster 2024-03-21T13:22:54.450464+0000 mgr.smithi005.rupoiq (mgr.14195) 129 : cluster [DBG] pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:22:56.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:55 smithi157 bash[23502]: cluster 2024-03-21T13:22:54.817598+0000 mon.smithi005 (mon.0) 656 : cluster [DBG] osdmap e37: 8 total, 8 up, 8 in 2024-03-21T13:22:56.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:55 smithi157 bash[23502]: audit 2024-03-21T13:22:54.940623+0000 mon.smithi005 (mon.0) 657 : audit [DBG] from='client.? 172.21.15.5:0/4149600656' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-21T13:22:57.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:56 smithi005 bash[18615]: cluster 2024-03-21T13:22:55.827444+0000 mon.smithi005 (mon.0) 658 : cluster [DBG] osdmap e38: 8 total, 8 up, 8 in 2024-03-21T13:22:57.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:56 smithi157 bash[23502]: cluster 2024-03-21T13:22:55.827444+0000 mon.smithi005 (mon.0) 658 : cluster [DBG] osdmap e38: 8 total, 8 up, 8 in 2024-03-21T13:22:58.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:57 smithi157 bash[23502]: cluster 2024-03-21T13:22:56.451027+0000 mgr.smithi005.rupoiq (mgr.14195) 130 : cluster [DBG] pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:22:58.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:57 smithi157 bash[23502]: cluster 2024-03-21T13:22:56.830338+0000 mon.smithi005 (mon.0) 659 : cluster [DBG] osdmap e39: 8 total, 8 up, 8 in 2024-03-21T13:22:58.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:57 smithi005 bash[18615]: cluster 2024-03-21T13:22:56.451027+0000 mgr.smithi005.rupoiq (mgr.14195) 130 : cluster [DBG] pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:22:58.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:57 smithi005 bash[18615]: cluster 2024-03-21T13:22:56.830338+0000 mon.smithi005 (mon.0) 659 : cluster [DBG] osdmap e39: 8 total, 8 up, 8 in 2024-03-21T13:23:00.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:22:59 smithi157 bash[23502]: cluster 2024-03-21T13:22:58.451834+0000 mgr.smithi005.rupoiq (mgr.14195) 131 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-21T13:23:00.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:22:59 smithi005 bash[18615]: cluster 2024-03-21T13:22:58.451834+0000 mgr.smithi005.rupoiq (mgr.14195) 131 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-21T13:23:00.488 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:01.222 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:00 smithi005 bash[18615]: audit 2024-03-21T13:22:59.951185+0000 mon.smithi005 (mon.0) 660 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.222 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:00 smithi005 bash[18615]: audit 2024-03-21T13:22:59.956343+0000 mon.smithi005 (mon.0) 661 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:00 smithi005 bash[18615]: audit 2024-03-21T13:23:00.513499+0000 mon.smithi005 (mon.0) 662 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:00 smithi005 bash[18615]: audit 2024-03-21T13:23:00.519041+0000 mon.smithi005 (mon.0) 663 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:00 smithi157 bash[23502]: audit 2024-03-21T13:22:59.951185+0000 mon.smithi005 (mon.0) 660 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:00 smithi157 bash[23502]: audit 2024-03-21T13:22:59.956343+0000 mon.smithi005 (mon.0) 661 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:00 smithi157 bash[23502]: audit 2024-03-21T13:23:00.513499+0000 mon.smithi005 (mon.0) 662 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:01.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:00 smithi157 bash[23502]: audit 2024-03-21T13:23:00.519041+0000 mon.smithi005 (mon.0) 663 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:02.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:01 smithi157 bash[23502]: cluster 2024-03-21T13:23:00.452273+0000 mgr.smithi005.rupoiq (mgr.14195) 132 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-21T13:23:02.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:01 smithi005 bash[18615]: cluster 2024-03-21T13:23:00.452273+0000 mgr.smithi005.rupoiq (mgr.14195) 132 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-21T13:23:03.132 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:23:03.132 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","created":"2024-03-21T13:17:48.180461+0000","modified":"2024-03-21T13:22:56.822601+0000","last_up_change":"2024-03-21T13:22:52.785497+0000","last_in_change":"2024-03-21T13:22:01.356253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T13:22:35.020508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4ab2013-8758-4234-bc49-0ecc066bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6801","nonce":597104579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6803","nonce":597104579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6807","nonce":597104579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6805","nonce":597104579}]},"public_addr":"172.21.15.157:6801/597104579","cluster_addr":"172.21.15.157:6803/597104579","heartbeat_back_addr":"172.21.15.157:6807/597104579","heartbeat_front_addr":"172.21.15.157:6805/597104579","state":["exists","up"]},{"osd":1,"uuid":"d8583d1a-19e1-4a58-a336-8430fd2b3951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6803","nonce":3365736749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6805","nonce":3365736749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6809","nonce":3365736749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6807","nonce":3365736749}]},"public_addr":"172.21.15.5:6803/3365736749","cluster_addr":"172.21.15.5:6805/3365736749","heartbeat_back_addr":"172.21.15.5:6809/3365736749","heartbeat_front_addr":"172.21.15.5:6807/3365736749","state":["exists","up"]},{"osd":2,"uuid":"30b48e81-eb62-4855-a3eb-ba35f36396a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6809","nonce":2024070729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6811","nonce":2024070729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6815","nonce":2024070729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6813","nonce":2024070729}]},"public_addr":"172.21.15.157:6809/2024070729","cluster_addr":"172.21.15.157:6811/2024070729","heartbeat_back_addr":"172.21.15.157:6815/2024070729","heartbeat_front_addr":"172.21.15.157:6813/2024070729","state":["exists","up"]},{"osd":3,"uuid":"7190feda-ce14-494f-921c-c2452a04bd26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6811","nonce":3158278152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6813","nonce":3158278152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6817","nonce":3158278152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6815","nonce":3158278152}]},"public_addr":"172.21.15.5:6811/3158278152","cluster_addr":"172.21.15.5:6813/3158278152","heartbeat_back_addr":"172.21.15.5:6817/3158278152","heartbeat_front_addr":"172.21.15.5:6815/3158278152","state":["exists","up"]},{"osd":4,"uuid":"ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6817","nonce":2088490995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6819","nonce":2088490995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6823","nonce":2088490995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6821","nonce":2088490995}]},"public_addr":"172.21.15.157:6817/2088490995","cluster_addr":"172.21.15.157:6819/2088490995","heartbeat_back_addr":"172.21.15.157:6823/2088490995","heartbeat_front_addr":"172.21.15.157:6821/2088490995","state":["exists","up"]},{"osd":5,"uuid":"fd0171b3-2226-4a0c-888a-c585d7b57ad3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6819","nonce":1563956884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6821","nonce":1563956884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6825","nonce":1563956884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6823","nonce":1563956884}]},"public_addr":"172.21.15.5:6819/1563956884","cluster_addr":"172.21.15.5:6821/1563956884","heartbeat_back_addr":"172.21.15.5:6825/1563956884","heartbeat_front_addr":"172.21.15.5:6823/1563956884","state":["exists","up"]},{"osd":6,"uuid":"c1782d9b-12a6-43a9-8977-a968a6e0ec19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6825","nonce":3915520186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6827","nonce":3915520186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6831","nonce":3915520186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6829","nonce":3915520186}]},"public_addr":"172.21.15.157:6825/3915520186","cluster_addr":"172.21.15.157:6827/3915520186","heartbeat_back_addr":"172.21.15.157:6831/3915520186","heartbeat_front_addr":"172.21.15.157:6829/3915520186","state":["exists","up"]},{"osd":7,"uuid":"6b372199-2b09-45d5-b8d5-e757aaa0fd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6827","nonce":2191649382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6829","nonce":2191649382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6833","nonce":2191649382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6831","nonce":2191649382}]},"public_addr":"172.21.15.5:6827/2191649382","cluster_addr":"172.21.15.5:6829/2191649382","heartbeat_back_addr":"172.21.15.5:6833/2191649382","heartbeat_front_addr":"172.21.15.5:6831/2191649382","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:26.745639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:31.027182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:32.333404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:37.817731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:38.584455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:44.134486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:43.442410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:51.133927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3632244294":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/3680892221":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/564801672":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6801/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/2329051809":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6800/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6801/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:6801/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/477752798":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/252669997":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/130561041":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/3086831898":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/442303618":"2024-03-22T13:18:19.766261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T13:23:03.782 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-21T13:22:35.020508+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-21T13:23:03.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-21T13:23:04.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:03 smithi005 bash[18615]: cluster 2024-03-21T13:23:02.452840+0000 mgr.smithi005.rupoiq (mgr.14195) 133 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-21T13:23:04.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:03 smithi005 bash[18615]: audit 2024-03-21T13:23:03.131476+0000 mon.smithi005 (mon.0) 664 : audit [DBG] from='client.? 172.21.15.5:0/91337431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:23:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:03 smithi157 bash[23502]: cluster 2024-03-21T13:23:02.452840+0000 mgr.smithi005.rupoiq (mgr.14195) 133 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-03-21T13:23:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:03 smithi157 bash[23502]: audit 2024-03-21T13:23:03.131476+0000 mon.smithi005 (mon.0) 664 : audit [DBG] from='client.? 172.21.15.5:0/91337431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:23:06.278 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:05 smithi157 bash[23502]: cluster 2024-03-21T13:23:04.453558+0000 mgr.smithi005.rupoiq (mgr.14195) 134 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-21T13:23:06.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:05 smithi005 bash[18615]: cluster 2024-03-21T13:23:04.453558+0000 mgr.smithi005.rupoiq (mgr.14195) 134 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-03-21T13:23:08.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:07 smithi157 bash[23502]: cluster 2024-03-21T13:23:06.454155+0000 mgr.smithi005.rupoiq (mgr.14195) 135 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-21T13:23:08.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:07 smithi005 bash[18615]: cluster 2024-03-21T13:23:06.454155+0000 mgr.smithi005.rupoiq (mgr.14195) 135 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-21T13:23:08.490 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:10.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:09 smithi157 bash[23502]: cluster 2024-03-21T13:23:08.454788+0000 mgr.smithi005.rupoiq (mgr.14195) 136 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-03-21T13:23:10.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:09 smithi157 bash[23502]: audit 2024-03-21T13:23:09.500039+0000 mon.smithi005 (mon.0) 665 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:10.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:09 smithi005 bash[18615]: cluster 2024-03-21T13:23:08.454788+0000 mgr.smithi005.rupoiq (mgr.14195) 136 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-03-21T13:23:10.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:09 smithi005 bash[18615]: audit 2024-03-21T13:23:09.500039+0000 mon.smithi005 (mon.0) 665 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:11.607 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: cluster 2024-03-21T13:23:10.455391+0000 mgr.smithi005.rupoiq (mgr.14195) 137 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: cephadm 2024-03-21T13:23:10.868852+0000 mgr.smithi005.rupoiq (mgr.14195) 138 : cephadm [INF] Detected new or changed devices on smithi157 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.876611+0000 mon.smithi005 (mon.0) 666 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.884804+0000 mon.smithi005 (mon.0) 667 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.886484+0000 mon.smithi005 (mon.0) 668 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.887487+0000 mon.smithi005 (mon.0) 669 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.888463+0000 mon.smithi005 (mon.0) 670 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.889391+0000 mon.smithi005 (mon.0) 671 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: cephadm 2024-03-21T13:23:10.890144+0000 mgr.smithi005.rupoiq (mgr.14195) 139 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 3772M 2024-03-21T13:23:12.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:10.894391+0000 mon.smithi005 (mon.0) 672 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:11 smithi157 bash[23502]: audit 2024-03-21T13:23:11.608706+0000 mon.smithi005 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.5:0/2497329972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-21T13:23:12.316 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: cluster 2024-03-21T13:23:10.455391+0000 mgr.smithi005.rupoiq (mgr.14195) 137 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:12.316 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: cephadm 2024-03-21T13:23:10.868852+0000 mgr.smithi005.rupoiq (mgr.14195) 138 : cephadm [INF] Detected new or changed devices on smithi157 2024-03-21T13:23:12.316 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.876611+0000 mon.smithi005 (mon.0) 666 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.884804+0000 mon.smithi005 (mon.0) 667 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.886484+0000 mon.smithi005 (mon.0) 668 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.887487+0000 mon.smithi005 (mon.0) 669 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.888463+0000 mon.smithi005 (mon.0) 670 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.889391+0000 mon.smithi005 (mon.0) 671 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: cephadm 2024-03-21T13:23:10.890144+0000 mgr.smithi005.rupoiq (mgr.14195) 139 : cephadm [INF] Adjusting osd_memory_target on smithi157 to 3772M 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:10.894391+0000 mon.smithi005 (mon.0) 672 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:12.317 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:11 smithi005 bash[18615]: audit 2024-03-21T13:23:11.608706+0000 mon.smithi005 (mon.0) 673 : audit [DBG] from='client.? 172.21.15.5:0/2497329972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-21T13:23:12.808 INFO:tasks.cephadm:Setting up client nodes... 2024-03-21T13:23:12.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: cluster 2024-03-21T13:23:12.459893+0000 mgr.smithi005.rupoiq (mgr.14195) 140 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: cephadm 2024-03-21T13:23:12.883516+0000 mgr.smithi005.rupoiq (mgr.14195) 141 : cephadm [INF] Detected new or changed devices on smithi005 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.890577+0000 mon.smithi005 (mon.0) 674 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.900168+0000 mon.smithi005 (mon.0) 675 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.903433+0000 mon.smithi005 (mon.0) 676 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.904937+0000 mon.smithi005 (mon.0) 677 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.906263+0000 mon.smithi005 (mon.0) 678 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.907589+0000 mon.smithi005 (mon.0) 679 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: cephadm 2024-03-21T13:23:12.908755+0000 mgr.smithi005.rupoiq (mgr.14195) 142 : cephadm [INF] Adjusting osd_memory_target on smithi005 to 3005M 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.914545+0000 mon.smithi005 (mon.0) 680 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.918946+0000 mon.smithi005 (mon.0) 681 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.920041+0000 mon.smithi005 (mon.0) 682 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.926845+0000 mon.smithi005 (mon.0) 683 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.932319+0000 mon.smithi005 (mon.0) 684 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.940658+0000 mon.smithi005 (mon.0) 685 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.941967+0000 mon.smithi005 (mon.0) 686 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.948325+0000 mon.smithi005 (mon.0) 687 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:23:14.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:13 smithi157 bash[23502]: audit 2024-03-21T13:23:12.949554+0000 mon.smithi005 (mon.0) 688 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: cluster 2024-03-21T13:23:12.459893+0000 mgr.smithi005.rupoiq (mgr.14195) 140 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: cephadm 2024-03-21T13:23:12.883516+0000 mgr.smithi005.rupoiq (mgr.14195) 141 : cephadm [INF] Detected new or changed devices on smithi005 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.890577+0000 mon.smithi005 (mon.0) 674 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.900168+0000 mon.smithi005 (mon.0) 675 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.903433+0000 mon.smithi005 (mon.0) 676 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.904937+0000 mon.smithi005 (mon.0) 677 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.906263+0000 mon.smithi005 (mon.0) 678 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.907589+0000 mon.smithi005 (mon.0) 679 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: cephadm 2024-03-21T13:23:12.908755+0000 mgr.smithi005.rupoiq (mgr.14195) 142 : cephadm [INF] Adjusting osd_memory_target on smithi005 to 3005M 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.914545+0000 mon.smithi005 (mon.0) 680 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.918946+0000 mon.smithi005 (mon.0) 681 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.920041+0000 mon.smithi005 (mon.0) 682 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.926845+0000 mon.smithi005 (mon.0) 683 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.932319+0000 mon.smithi005 (mon.0) 684 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.940658+0000 mon.smithi005 (mon.0) 685 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.941967+0000 mon.smithi005 (mon.0) 686 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.948325+0000 mon.smithi005 (mon.0) 687 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-21T13:23:14.304 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:13 smithi005 bash[18615]: audit 2024-03-21T13:23:12.949554+0000 mon.smithi005 (mon.0) 688 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:23:16.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:15 smithi157 bash[23502]: cluster 2024-03-21T13:23:14.460599+0000 mgr.smithi005.rupoiq (mgr.14195) 143 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:16.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:15 smithi005 bash[18615]: cluster 2024-03-21T13:23:14.460599+0000 mgr.smithi005.rupoiq (mgr.14195) 143 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:18.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:17 smithi157 bash[23502]: cluster 2024-03-21T13:23:16.461225+0000 mgr.smithi005.rupoiq (mgr.14195) 144 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:18.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:17 smithi005 bash[18615]: cluster 2024-03-21T13:23:16.461225+0000 mgr.smithi005.rupoiq (mgr.14195) 144 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:20.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:19 smithi157 bash[23502]: cluster 2024-03-21T13:23:18.461939+0000 mgr.smithi005.rupoiq (mgr.14195) 145 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:20.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:19 smithi005 bash[18615]: cluster 2024-03-21T13:23:18.461939+0000 mgr.smithi005.rupoiq (mgr.14195) 145 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:21.526 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-03-21T13:23:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDJNPxlzsZMHxAAw60jKm3BJSt0P+IzF13fIQ== 2024-03-21T13:23:22.145 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:23:22.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-21T13:23:22.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-21T13:23:22.155 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:21 smithi005 bash[18615]: cluster 2024-03-21T13:23:20.462636+0000 mgr.smithi005.rupoiq (mgr.14195) 146 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:22.155 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:21 smithi005 bash[18615]: audit 2024-03-21T13:23:21.524903+0000 mon.smithi005 (mon.0) 689 : audit [INF] from='client.? 172.21.15.5:0/2986558145' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:22.155 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:21 smithi005 bash[18615]: audit 2024-03-21T13:23:21.527358+0000 mon.smithi005 (mon.0) 690 : audit [INF] from='client.? 172.21.15.5:0/2986558145' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-21T13:23:22.165 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-21T13:23:22.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:21 smithi157 bash[23502]: cluster 2024-03-21T13:23:20.462636+0000 mgr.smithi005.rupoiq (mgr.14195) 146 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:22.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:21 smithi157 bash[23502]: audit 2024-03-21T13:23:21.524903+0000 mon.smithi005 (mon.0) 689 : audit [INF] from='client.? 172.21.15.5:0/2986558145' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:22.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:21 smithi157 bash[23502]: audit 2024-03-21T13:23:21.527358+0000 mon.smithi005 (mon.0) 690 : audit [INF] from='client.? 172.21.15.5:0/2986558145' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-21T13:23:24.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:23 smithi157 bash[23502]: cluster 2024-03-21T13:23:22.463364+0000 mgr.smithi005.rupoiq (mgr.14195) 147 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:24.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:23 smithi005 bash[18615]: cluster 2024-03-21T13:23:22.463364+0000 mgr.smithi005.rupoiq (mgr.14195) 147 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:25.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:24 smithi157 bash[23502]: audit 2024-03-21T13:23:24.506077+0000 mon.smithi005 (mon.0) 691 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:25.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:24 smithi005 bash[18615]: audit 2024-03-21T13:23:24.506077+0000 mon.smithi005 (mon.0) 691 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:26.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:25 smithi157 bash[23502]: cluster 2024-03-21T13:23:24.464128+0000 mgr.smithi005.rupoiq (mgr.14195) 148 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:26.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:25 smithi005 bash[18615]: cluster 2024-03-21T13:23:24.464128+0000 mgr.smithi005.rupoiq (mgr.14195) 148 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:26.939 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi157/config 2024-03-21T13:23:28.185 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:27 smithi157 bash[23502]: cluster 2024-03-21T13:23:26.464701+0000 mgr.smithi005.rupoiq (mgr.14195) 149 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:28.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:27 smithi005 bash[18615]: cluster 2024-03-21T13:23:26.464701+0000 mgr.smithi005.rupoiq (mgr.14195) 149 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:30.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:29 smithi005 bash[18615]: cluster 2024-03-21T13:23:28.465314+0000 mgr.smithi005.rupoiq (mgr.14195) 150 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:30.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:29 smithi157 bash[23502]: cluster 2024-03-21T13:23:28.465314+0000 mgr.smithi005.rupoiq (mgr.14195) 150 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:31.392 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-03-21T13:23:31.392 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQDTNPxlzlshFxAAqd3lOigl+zn/fL/lHy4Bug== 2024-03-21T13:23:32.187 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:31 smithi005 bash[18615]: cluster 2024-03-21T13:23:30.465920+0000 mgr.smithi005.rupoiq (mgr.14195) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:32.188 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:31 smithi005 bash[18615]: audit 2024-03-21T13:23:31.387447+0000 mon.smithi157 (mon.1) 22 : audit [INF] from='client.? 172.21.15.157:0/3741375218' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:32.188 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:31 smithi005 bash[18615]: audit 2024-03-21T13:23:31.387659+0000 mon.smithi005 (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:32.188 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:31 smithi005 bash[18615]: audit 2024-03-21T13:23:31.390656+0000 mon.smithi005 (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-21T13:23:32.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:31 smithi157 bash[23502]: cluster 2024-03-21T13:23:30.465920+0000 mgr.smithi005.rupoiq (mgr.14195) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:32.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:31 smithi157 bash[23502]: audit 2024-03-21T13:23:31.387447+0000 mon.smithi157 (mon.1) 22 : audit [INF] from='client.? 172.21.15.157:0/3741375218' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:32.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:31 smithi157 bash[23502]: audit 2024-03-21T13:23:31.387659+0000 mon.smithi005 (mon.0) 692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-21T13:23:32.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:31 smithi157 bash[23502]: audit 2024-03-21T13:23:31.390656+0000 mon.smithi005 (mon.0) 693 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-21T13:23:32.664 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:23:32.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-21T13:23:32.664 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-21T13:23:32.728 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-21T13:23:32.729 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-21T13:23:32.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph mgr dump --format=json 2024-03-21T13:23:34.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:33 smithi157 bash[23502]: cluster 2024-03-21T13:23:32.466332+0000 mgr.smithi005.rupoiq (mgr.14195) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:34.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:33 smithi005 bash[18615]: cluster 2024-03-21T13:23:32.466332+0000 mgr.smithi005.rupoiq (mgr.14195) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:36.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:35 smithi157 bash[23502]: cluster 2024-03-21T13:23:34.466962+0000 mgr.smithi005.rupoiq (mgr.14195) 153 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:36.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:35 smithi005 bash[18615]: cluster 2024-03-21T13:23:34.466962+0000 mgr.smithi005.rupoiq (mgr.14195) 153 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:37.315 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:38.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:37 smithi157 bash[23502]: cluster 2024-03-21T13:23:36.467568+0000 mgr.smithi005.rupoiq (mgr.14195) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:38.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:37 smithi005 bash[18615]: cluster 2024-03-21T13:23:36.467568+0000 mgr.smithi005.rupoiq (mgr.14195) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:40.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:39 smithi157 bash[23502]: cluster 2024-03-21T13:23:38.468063+0000 mgr.smithi005.rupoiq (mgr.14195) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:40.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:39 smithi157 bash[23502]: audit 2024-03-21T13:23:39.506702+0000 mon.smithi005 (mon.0) 694 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:40.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:39 smithi005 bash[18615]: cluster 2024-03-21T13:23:38.468063+0000 mgr.smithi005.rupoiq (mgr.14195) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:40.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:39 smithi005 bash[18615]: audit 2024-03-21T13:23:39.506702+0000 mon.smithi005 (mon.0) 694 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:41.335 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:23:42.150 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"flags":0,"active_gid":14195,"active_name":"smithi005.rupoiq","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":474450543},{"type":"v1","addr":"172.21.15.5:6801","nonce":474450543}]},"active_addr":"172.21.15.5:6801/474450543","active_change":"2024-03-21T13:20:24.409692+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14212,"name":"smithi157.xdzklg","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/","prometheus":"http://172.21.15.5:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2831688384}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2464004707}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3091409127}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":1853614682}]}]} 2024-03-21T13:23:42.155 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-21T13:23:42.155 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-21T13:23:42.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-21T13:23:42.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:41 smithi157 bash[23502]: cluster 2024-03-21T13:23:40.468758+0000 mgr.smithi005.rupoiq (mgr.14195) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:42.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:41 smithi157 bash[23502]: audit 2024-03-21T13:23:41.331169+0000 mon.smithi005 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.5:0/3462456196' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-21T13:23:42.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:41 smithi005 bash[18615]: cluster 2024-03-21T13:23:40.468758+0000 mgr.smithi005.rupoiq (mgr.14195) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:42.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:41 smithi005 bash[18615]: audit 2024-03-21T13:23:41.331169+0000 mon.smithi005 (mon.0) 695 : audit [DBG] from='client.? 172.21.15.5:0/3462456196' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-21T13:23:43.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:43 smithi157 bash[23502]: audit 2024-03-21T13:23:42.097273+0000 mon.smithi005 (mon.0) 696 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:43 smithi157 bash[23502]: audit 2024-03-21T13:23:42.110522+0000 mon.smithi005 (mon.0) 697 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:43 smithi157 bash[23502]: cluster 2024-03-21T13:23:42.469435+0000 mgr.smithi005.rupoiq (mgr.14195) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:43.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:43 smithi157 bash[23502]: audit 2024-03-21T13:23:42.576738+0000 mon.smithi005 (mon.0) 698 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:43 smithi157 bash[23502]: audit 2024-03-21T13:23:42.586422+0000 mon.smithi005 (mon.0) 699 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:43 smithi005 bash[18615]: audit 2024-03-21T13:23:42.097273+0000 mon.smithi005 (mon.0) 696 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:43 smithi005 bash[18615]: audit 2024-03-21T13:23:42.110522+0000 mon.smithi005 (mon.0) 697 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:43 smithi005 bash[18615]: cluster 2024-03-21T13:23:42.469435+0000 mgr.smithi005.rupoiq (mgr.14195) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:43.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:43 smithi005 bash[18615]: audit 2024-03-21T13:23:42.576738+0000 mon.smithi005 (mon.0) 698 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:43.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:43 smithi005 bash[18615]: audit 2024-03-21T13:23:42.586422+0000 mon.smithi005 (mon.0) 699 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:23:45.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:45 smithi157 bash[23502]: cluster 2024-03-21T13:23:44.470173+0000 mgr.smithi005.rupoiq (mgr.14195) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:45.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:45 smithi005 bash[18615]: cluster 2024-03-21T13:23:44.470173+0000 mgr.smithi005.rupoiq (mgr.14195) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:46.976 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:47.790 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:47 smithi005 bash[18615]: cluster 2024-03-21T13:23:46.470686+0000 mgr.smithi005.rupoiq (mgr.14195) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:47.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:47 smithi157 bash[23502]: cluster 2024-03-21T13:23:46.470686+0000 mgr.smithi005.rupoiq (mgr.14195) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:23:49.740 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","created":"2024-03-21T13:17:48.180461+0000","modified":"2024-03-21T13:22:56.822601+0000","last_up_change":"2024-03-21T13:22:52.785497+0000","last_in_change":"2024-03-21T13:22:01.356253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T13:22:35.020508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4ab2013-8758-4234-bc49-0ecc066bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6801","nonce":597104579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6803","nonce":597104579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6807","nonce":597104579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6805","nonce":597104579}]},"public_addr":"172.21.15.157:6801/597104579","cluster_addr":"172.21.15.157:6803/597104579","heartbeat_back_addr":"172.21.15.157:6807/597104579","heartbeat_front_addr":"172.21.15.157:6805/597104579","state":["exists","up"]},{"osd":1,"uuid":"d8583d1a-19e1-4a58-a336-8430fd2b3951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6803","nonce":3365736749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6805","nonce":3365736749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6809","nonce":3365736749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6807","nonce":3365736749}]},"public_addr":"172.21.15.5:6803/3365736749","cluster_addr":"172.21.15.5:6805/3365736749","heartbeat_back_addr":"172.21.15.5:6809/3365736749","heartbeat_front_addr":"172.21.15.5:6807/3365736749","state":["exists","up"]},{"osd":2,"uuid":"30b48e81-eb62-4855-a3eb-ba35f36396a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6809","nonce":2024070729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6811","nonce":2024070729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6815","nonce":2024070729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6813","nonce":2024070729}]},"public_addr":"172.21.15.157:6809/2024070729","cluster_addr":"172.21.15.157:6811/2024070729","heartbeat_back_addr":"172.21.15.157:6815/2024070729","heartbeat_front_addr":"172.21.15.157:6813/2024070729","state":["exists","up"]},{"osd":3,"uuid":"7190feda-ce14-494f-921c-c2452a04bd26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6811","nonce":3158278152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6813","nonce":3158278152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6817","nonce":3158278152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6815","nonce":3158278152}]},"public_addr":"172.21.15.5:6811/3158278152","cluster_addr":"172.21.15.5:6813/3158278152","heartbeat_back_addr":"172.21.15.5:6817/3158278152","heartbeat_front_addr":"172.21.15.5:6815/3158278152","state":["exists","up"]},{"osd":4,"uuid":"ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6817","nonce":2088490995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6819","nonce":2088490995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6823","nonce":2088490995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6821","nonce":2088490995}]},"public_addr":"172.21.15.157:6817/2088490995","cluster_addr":"172.21.15.157:6819/2088490995","heartbeat_back_addr":"172.21.15.157:6823/2088490995","heartbeat_front_addr":"172.21.15.157:6821/2088490995","state":["exists","up"]},{"osd":5,"uuid":"fd0171b3-2226-4a0c-888a-c585d7b57ad3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6819","nonce":1563956884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6821","nonce":1563956884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6825","nonce":1563956884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6823","nonce":1563956884}]},"public_addr":"172.21.15.5:6819/1563956884","cluster_addr":"172.21.15.5:6821/1563956884","heartbeat_back_addr":"172.21.15.5:6825/1563956884","heartbeat_front_addr":"172.21.15.5:6823/1563956884","state":["exists","up"]},{"osd":6,"uuid":"c1782d9b-12a6-43a9-8977-a968a6e0ec19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6825","nonce":3915520186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6827","nonce":3915520186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6831","nonce":3915520186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6829","nonce":3915520186}]},"public_addr":"172.21.15.157:6825/3915520186","cluster_addr":"172.21.15.157:6827/3915520186","heartbeat_back_addr":"172.21.15.157:6831/3915520186","heartbeat_front_addr":"172.21.15.157:6829/3915520186","state":["exists","up"]},{"osd":7,"uuid":"6b372199-2b09-45d5-b8d5-e757aaa0fd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6827","nonce":2191649382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6829","nonce":2191649382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6833","nonce":2191649382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6831","nonce":2191649382}]},"public_addr":"172.21.15.5:6827/2191649382","cluster_addr":"172.21.15.5:6829/2191649382","heartbeat_back_addr":"172.21.15.5:6833/2191649382","heartbeat_front_addr":"172.21.15.5:6831/2191649382","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:26.745639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:31.027182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:32.333404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:37.817731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:38.584455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:44.134486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:43.442410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:51.133927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3632244294":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/3680892221":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/564801672":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6801/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/2329051809":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6800/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6801/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:6801/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/477752798":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/252669997":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/130561041":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/3086831898":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/442303618":"2024-03-22T13:18:19.766261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T13:23:49.754 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:49 smithi005 bash[18615]: cluster 2024-03-21T13:23:48.471332+0000 mgr.smithi005.rupoiq (mgr.14195) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:49.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:49 smithi157 bash[23502]: cluster 2024-03-21T13:23:48.471332+0000 mgr.smithi005.rupoiq (mgr.14195) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:50.463 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-21T13:23:50.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd dump --format=json 2024-03-21T13:23:50.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:50 smithi157 bash[23502]: audit 2024-03-21T13:23:49.739981+0000 mon.smithi005 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.5:0/2443886868' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:23:50.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:50 smithi005 bash[18615]: audit 2024-03-21T13:23:49.739981+0000 mon.smithi005 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.5:0/2443886868' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:23:51.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:51 smithi005 bash[18615]: cluster 2024-03-21T13:23:50.472002+0000 mgr.smithi005.rupoiq (mgr.14195) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:52.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:51 smithi157 bash[23502]: cluster 2024-03-21T13:23:50.472002+0000 mgr.smithi005.rupoiq (mgr.14195) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:53.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:53 smithi005 bash[18615]: cluster 2024-03-21T13:23:52.472584+0000 mgr.smithi005.rupoiq (mgr.14195) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:54.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:53 smithi157 bash[23502]: cluster 2024-03-21T13:23:52.472584+0000 mgr.smithi005.rupoiq (mgr.14195) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:55.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:54 smithi157 bash[23502]: audit 2024-03-21T13:23:54.507005+0000 mon.smithi005 (mon.0) 701 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:55.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:54 smithi005 bash[18615]: audit 2024-03-21T13:23:54.507005+0000 mon.smithi005 (mon.0) 701 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:23:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:23:55.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:55 smithi157 bash[23502]: cluster 2024-03-21T13:23:54.473185+0000 mgr.smithi005.rupoiq (mgr.14195) 163 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:55 smithi005 bash[18615]: cluster 2024-03-21T13:23:54.473185+0000 mgr.smithi005.rupoiq (mgr.14195) 163 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:57.828 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:57 smithi005 bash[18615]: cluster 2024-03-21T13:23:56.473886+0000 mgr.smithi005.rupoiq (mgr.14195) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:58.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:57 smithi157 bash[23502]: cluster 2024-03-21T13:23:56.473886+0000 mgr.smithi005.rupoiq (mgr.14195) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:23:58.143 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:23:58.143 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"fsid":"3164d712-e785-11ee-95cd-87774f69a715","created":"2024-03-21T13:17:48.180461+0000","modified":"2024-03-21T13:22:56.822601+0000","last_up_change":"2024-03-21T13:22:52.785497+0000","last_in_change":"2024-03-21T13:22:01.356253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-21T13:22:35.020508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f4ab2013-8758-4234-bc49-0ecc066bc1b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6801","nonce":597104579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6803","nonce":597104579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6807","nonce":597104579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":597104579},{"type":"v1","addr":"172.21.15.157:6805","nonce":597104579}]},"public_addr":"172.21.15.157:6801/597104579","cluster_addr":"172.21.15.157:6803/597104579","heartbeat_back_addr":"172.21.15.157:6807/597104579","heartbeat_front_addr":"172.21.15.157:6805/597104579","state":["exists","up"]},{"osd":1,"uuid":"d8583d1a-19e1-4a58-a336-8430fd2b3951","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":20,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6803","nonce":3365736749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6805","nonce":3365736749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6809","nonce":3365736749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3365736749},{"type":"v1","addr":"172.21.15.5:6807","nonce":3365736749}]},"public_addr":"172.21.15.5:6803/3365736749","cluster_addr":"172.21.15.5:6805/3365736749","heartbeat_back_addr":"172.21.15.5:6809/3365736749","heartbeat_front_addr":"172.21.15.5:6807/3365736749","state":["exists","up"]},{"osd":2,"uuid":"30b48e81-eb62-4855-a3eb-ba35f36396a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6809","nonce":2024070729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6811","nonce":2024070729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6815","nonce":2024070729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":2024070729},{"type":"v1","addr":"172.21.15.157:6813","nonce":2024070729}]},"public_addr":"172.21.15.157:6809/2024070729","cluster_addr":"172.21.15.157:6811/2024070729","heartbeat_back_addr":"172.21.15.157:6815/2024070729","heartbeat_front_addr":"172.21.15.157:6813/2024070729","state":["exists","up"]},{"osd":3,"uuid":"7190feda-ce14-494f-921c-c2452a04bd26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6811","nonce":3158278152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6813","nonce":3158278152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6817","nonce":3158278152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":3158278152},{"type":"v1","addr":"172.21.15.5:6815","nonce":3158278152}]},"public_addr":"172.21.15.5:6811/3158278152","cluster_addr":"172.21.15.5:6813/3158278152","heartbeat_back_addr":"172.21.15.5:6817/3158278152","heartbeat_front_addr":"172.21.15.5:6815/3158278152","state":["exists","up"]},{"osd":4,"uuid":"ffe20d55-8713-4ae9-a3db-29f3e5c7f6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6817","nonce":2088490995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6819","nonce":2088490995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6823","nonce":2088490995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2088490995},{"type":"v1","addr":"172.21.15.157:6821","nonce":2088490995}]},"public_addr":"172.21.15.157:6817/2088490995","cluster_addr":"172.21.15.157:6819/2088490995","heartbeat_back_addr":"172.21.15.157:6823/2088490995","heartbeat_front_addr":"172.21.15.157:6821/2088490995","state":["exists","up"]},{"osd":5,"uuid":"fd0171b3-2226-4a0c-888a-c585d7b57ad3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6819","nonce":1563956884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6821","nonce":1563956884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6825","nonce":1563956884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":1563956884},{"type":"v1","addr":"172.21.15.5:6823","nonce":1563956884}]},"public_addr":"172.21.15.5:6819/1563956884","cluster_addr":"172.21.15.5:6821/1563956884","heartbeat_back_addr":"172.21.15.5:6825/1563956884","heartbeat_front_addr":"172.21.15.5:6823/1563956884","state":["exists","up"]},{"osd":6,"uuid":"c1782d9b-12a6-43a9-8977-a968a6e0ec19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6825","nonce":3915520186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6827","nonce":3915520186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6831","nonce":3915520186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":3915520186},{"type":"v1","addr":"172.21.15.157:6829","nonce":3915520186}]},"public_addr":"172.21.15.157:6825/3915520186","cluster_addr":"172.21.15.157:6827/3915520186","heartbeat_back_addr":"172.21.15.157:6831/3915520186","heartbeat_front_addr":"172.21.15.157:6829/3915520186","state":["exists","up"]},{"osd":7,"uuid":"6b372199-2b09-45d5-b8d5-e757aaa0fd37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6827","nonce":2191649382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6829","nonce":2191649382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6833","nonce":2191649382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2191649382},{"type":"v1","addr":"172.21.15.5:6831","nonce":2191649382}]},"public_addr":"172.21.15.5:6827/2191649382","cluster_addr":"172.21.15.5:6829/2191649382","heartbeat_back_addr":"172.21.15.5:6833/2191649382","heartbeat_front_addr":"172.21.15.5:6831/2191649382","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:26.745639+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:31.027182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:32.333404+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:37.817731+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:38.584455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:44.134486+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:43.442410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-21T13:22:51.133927+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/3632244294":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/3680892221":"2024-03-22T13:20:24.409567+0000","172.21.15.5:0/564801672":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6801/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/2329051809":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6800/59438047":"2024-03-22T13:19:07.445467+0000","172.21.15.5:6801/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:6801/1098787881":"2024-03-22T13:20:24.409567+0000","172.21.15.5:6800/3937389073":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/477752798":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/252669997":"2024-03-22T13:18:19.766261+0000","172.21.15.5:0/130561041":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/3086831898":"2024-03-22T13:19:07.445467+0000","172.21.15.5:0/442303618":"2024-03-22T13:18:19.766261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-21T13:23:58.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:58 smithi005 bash[18615]: audit 2024-03-21T13:23:58.144015+0000 mon.smithi005 (mon.0) 702 : audit [DBG] from='client.? 172.21.15.5:0/3105838084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:23:58.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-21T13:23:58.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-21T13:23:58.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-21T13:23:58.852 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-21T13:23:58.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-21T13:23:58.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-21T13:23:58.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-21T13:23:58.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-21T13:23:59.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:58 smithi157 bash[23502]: audit 2024-03-21T13:23:58.144015+0000 mon.smithi005 (mon.0) 702 : audit [DBG] from='client.? 172.21.15.5:0/3105838084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-21T13:24:00.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:23:59 smithi157 bash[23502]: cluster 2024-03-21T13:23:58.474583+0000 mgr.smithi005.rupoiq (mgr.14195) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:00.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:23:59 smithi005 bash[18615]: cluster 2024-03-21T13:23:58.474583+0000 mgr.smithi005.rupoiq (mgr.14195) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:02.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:01 smithi157 bash[23502]: cluster 2024-03-21T13:24:00.475113+0000 mgr.smithi005.rupoiq (mgr.14195) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:02.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:01 smithi005 bash[18615]: cluster 2024-03-21T13:24:00.475113+0000 mgr.smithi005.rupoiq (mgr.14195) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:03.776 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.778 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:03.779 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:04.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:03 smithi157 bash[23502]: cluster 2024-03-21T13:24:02.475730+0000 mgr.smithi005.rupoiq (mgr.14195) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:04.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:03 smithi005 bash[18615]: cluster 2024-03-21T13:24:02.475730+0000 mgr.smithi005.rupoiq (mgr.14195) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:05.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:05 smithi157 bash[23502]: cluster 2024-03-21T13:24:04.476237+0000 mgr.smithi005.rupoiq (mgr.14195) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:05.914 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:05 smithi005 bash[18615]: cluster 2024-03-21T13:24:04.476237+0000 mgr.smithi005.rupoiq (mgr.14195) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:07.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:07 smithi005 bash[18615]: cluster 2024-03-21T13:24:06.476909+0000 mgr.smithi005.rupoiq (mgr.14195) 169 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:08.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:07 smithi157 bash[23502]: cluster 2024-03-21T13:24:06.476909+0000 mgr.smithi005.rupoiq (mgr.14195) 169 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:09.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:09 smithi005 bash[18615]: cluster 2024-03-21T13:24:08.477648+0000 mgr.smithi005.rupoiq (mgr.14195) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:09.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:09 smithi005 bash[18615]: audit 2024-03-21T13:24:09.507008+0000 mon.smithi005 (mon.0) 703 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:10.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:09 smithi157 bash[23502]: cluster 2024-03-21T13:24:08.477648+0000 mgr.smithi005.rupoiq (mgr.14195) 170 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:10.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:09 smithi157 bash[23502]: audit 2024-03-21T13:24:09.507008+0000 mon.smithi005 (mon.0) 703 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:11.803 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:11 smithi005 bash[18615]: cluster 2024-03-21T13:24:10.478329+0000 mgr.smithi005.rupoiq (mgr.14195) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:12.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:11 smithi157 bash[23502]: cluster 2024-03-21T13:24:10.478329+0000 mgr.smithi005.rupoiq (mgr.14195) 171 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:14.023 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:13 smithi005 bash[18615]: cluster 2024-03-21T13:24:12.478919+0000 mgr.smithi005.rupoiq (mgr.14195) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:13 smithi157 bash[23502]: cluster 2024-03-21T13:24:12.478919+0000 mgr.smithi005.rupoiq (mgr.14195) 172 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:15.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:15 smithi157 bash[23502]: cluster 2024-03-21T13:24:14.479510+0000 mgr.smithi005.rupoiq (mgr.14195) 173 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:15.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:15 smithi005 bash[18615]: cluster 2024-03-21T13:24:14.479510+0000 mgr.smithi005.rupoiq (mgr.14195) 173 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:17.395 INFO:teuthology.orchestra.run.smithi005.stdout:133143986196 2024-03-21T13:24:17.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-21T13:24:17.608 INFO:teuthology.orchestra.run.smithi005.stdout:115964117013 2024-03-21T13:24:17.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-21T13:24:17.654 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:17 smithi005 bash[18615]: cluster 2024-03-21T13:24:16.480131+0000 mgr.smithi005.rupoiq (mgr.14195) 174 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:18.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:17 smithi157 bash[23502]: cluster 2024-03-21T13:24:16.480131+0000 mgr.smithi005.rupoiq (mgr.14195) 174 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:18.916 INFO:teuthology.orchestra.run.smithi005.stdout:68719476761 2024-03-21T13:24:18.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-21T13:24:19.467 INFO:teuthology.orchestra.run.smithi005.stdout:85899345943 2024-03-21T13:24:19.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-21T13:24:19.813 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:19 smithi005 bash[18615]: cluster 2024-03-21T13:24:18.480737+0000 mgr.smithi005.rupoiq (mgr.14195) 175 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:20.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:19 smithi157 bash[23502]: cluster 2024-03-21T13:24:18.480737+0000 mgr.smithi005.rupoiq (mgr.14195) 175 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:20.473 INFO:teuthology.orchestra.run.smithi005.stdout:133143986197 2024-03-21T13:24:20.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-21T13:24:21.204 INFO:teuthology.orchestra.run.smithi005.stdout:90194313240 2024-03-21T13:24:21.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-21T13:24:21.410 INFO:teuthology.orchestra.run.smithi005.stdout:150323855380 2024-03-21T13:24:21.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-21T13:24:21.808 INFO:teuthology.orchestra.run.smithi005.stdout:111669149718 2024-03-21T13:24:21.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-21T13:24:22.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:21 smithi157 bash[23502]: cluster 2024-03-21T13:24:20.481184+0000 mgr.smithi005.rupoiq (mgr.14195) 176 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:22.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:21 smithi005 bash[18615]: cluster 2024-03-21T13:24:20.481184+0000 mgr.smithi005.rupoiq (mgr.14195) 176 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:23.952 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:23.953 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:23.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:23 smithi005 bash[18615]: cluster 2024-03-21T13:24:22.481745+0000 mgr.smithi005.rupoiq (mgr.14195) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:24.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:23 smithi157 bash[23502]: cluster 2024-03-21T13:24:22.481745+0000 mgr.smithi005.rupoiq (mgr.14195) 177 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:24.978 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:24.980 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:24.994 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:24 smithi005 bash[18615]: audit 2024-03-21T13:24:24.510848+0000 mon.smithi005 (mon.0) 704 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:25.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:24 smithi157 bash[23502]: audit 2024-03-21T13:24:24.510848+0000 mon.smithi005 (mon.0) 704 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:25.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:25 smithi157 bash[23502]: cluster 2024-03-21T13:24:24.482201+0000 mgr.smithi005.rupoiq (mgr.14195) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:25.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:25 smithi005 bash[18615]: cluster 2024-03-21T13:24:24.482201+0000 mgr.smithi005.rupoiq (mgr.14195) 178 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:25.994 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:25.995 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:28.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:27 smithi157 bash[23502]: cluster 2024-03-21T13:24:26.482794+0000 mgr.smithi005.rupoiq (mgr.14195) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:28.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:27 smithi005 bash[18615]: cluster 2024-03-21T13:24:26.482794+0000 mgr.smithi005.rupoiq (mgr.14195) 179 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:29.959 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:29 smithi005 bash[18615]: cluster 2024-03-21T13:24:28.483420+0000 mgr.smithi005.rupoiq (mgr.14195) 180 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:30.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:29 smithi157 bash[23502]: cluster 2024-03-21T13:24:28.483420+0000 mgr.smithi005.rupoiq (mgr.14195) 180 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:31.830 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:31 smithi005 bash[18615]: cluster 2024-03-21T13:24:30.484032+0000 mgr.smithi005.rupoiq (mgr.14195) 181 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:32.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:31 smithi157 bash[23502]: cluster 2024-03-21T13:24:30.484032+0000 mgr.smithi005.rupoiq (mgr.14195) 181 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:32.394 INFO:teuthology.orchestra.run.smithi005.stdout:133143986199 2024-03-21T13:24:32.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:32 smithi005 bash[18615]: audit 2024-03-21T13:24:32.395028+0000 mon.smithi005 (mon.0) 705 : audit [DBG] from='client.? 172.21.15.5:0/1653865748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-21T13:24:33.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:32 smithi157 bash[23502]: audit 2024-03-21T13:24:32.395028+0000 mon.smithi005 (mon.0) 705 : audit [DBG] from='client.? 172.21.15.5:0/1653865748' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-21T13:24:34.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:33 smithi157 bash[23502]: cluster 2024-03-21T13:24:32.484373+0000 mgr.smithi005.rupoiq (mgr.14195) 182 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:34.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:33 smithi005 bash[18615]: cluster 2024-03-21T13:24:32.484373+0000 mgr.smithi005.rupoiq (mgr.14195) 182 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:35.360 INFO:teuthology.orchestra.run.smithi005.stdout:115964117016 2024-03-21T13:24:35.780 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986196 got 133143986199 for osd.6 2024-03-21T13:24:35.780 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:35.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:35 smithi157 bash[23502]: cluster 2024-03-21T13:24:34.484911+0000 mgr.smithi005.rupoiq (mgr.14195) 183 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:35.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:35 smithi157 bash[23502]: audit 2024-03-21T13:24:35.361998+0000 mon.smithi005 (mon.0) 706 : audit [DBG] from='client.? 172.21.15.5:0/1247680724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-21T13:24:36.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:35 smithi005 bash[18615]: cluster 2024-03-21T13:24:34.484911+0000 mgr.smithi005.rupoiq (mgr.14195) 183 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:36.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:35 smithi005 bash[18615]: audit 2024-03-21T13:24:35.361998+0000 mon.smithi005 (mon.0) 706 : audit [DBG] from='client.? 172.21.15.5:0/1247680724' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-21T13:24:36.774 INFO:teuthology.orchestra.run.smithi005.stdout:111669149721 2024-03-21T13:24:36.924 INFO:teuthology.orchestra.run.smithi005.stdout:133143986200 2024-03-21T13:24:37.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117013 got 115964117016 for osd.4 2024-03-21T13:24:37.320 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:38.004 INFO:teuthology.orchestra.run.smithi005.stdout:150323855383 2024-03-21T13:24:38.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:37 smithi005 bash[18615]: cluster 2024-03-21T13:24:36.485263+0000 mgr.smithi005.rupoiq (mgr.14195) 184 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:38.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:37 smithi005 bash[18615]: audit 2024-03-21T13:24:36.775082+0000 mon.smithi005 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.5:0/735957365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-21T13:24:38.018 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:37 smithi005 bash[18615]: audit 2024-03-21T13:24:36.925505+0000 mon.smithi005 (mon.0) 708 : audit [DBG] from='client.? 172.21.15.5:0/2464790689' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-21T13:24:38.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:37 smithi157 bash[23502]: cluster 2024-03-21T13:24:36.485263+0000 mgr.smithi005.rupoiq (mgr.14195) 184 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:38.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:37 smithi157 bash[23502]: audit 2024-03-21T13:24:36.775082+0000 mon.smithi005 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.5:0/735957365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-21T13:24:38.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:37 smithi157 bash[23502]: audit 2024-03-21T13:24:36.925505+0000 mon.smithi005 (mon.0) 708 : audit [DBG] from='client.? 172.21.15.5:0/2464790689' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-21T13:24:38.806 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:38 smithi005 bash[18615]: audit 2024-03-21T13:24:38.005713+0000 mon.smithi005 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.5:0/2679973882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-21T13:24:38.888 INFO:teuthology.orchestra.run.smithi005.stdout:68719476765 2024-03-21T13:24:39.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:38 smithi157 bash[23502]: audit 2024-03-21T13:24:38.005713+0000 mon.smithi005 (mon.0) 709 : audit [DBG] from='client.? 172.21.15.5:0/2679973882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-21T13:24:39.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986197 got 133143986200 for osd.5 2024-03-21T13:24:39.253 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:39.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149718 got 111669149721 for osd.3 2024-03-21T13:24:39.808 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:39.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:39 smithi005 bash[18615]: cluster 2024-03-21T13:24:38.485633+0000 mgr.smithi005.rupoiq (mgr.14195) 185 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:39.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:39 smithi005 bash[18615]: audit 2024-03-21T13:24:38.890055+0000 mon.smithi005 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.5:0/3149491211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-21T13:24:39.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:39 smithi005 bash[18615]: audit 2024-03-21T13:24:39.511606+0000 mon.smithi005 (mon.0) 711 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:39 smithi157 bash[23502]: cluster 2024-03-21T13:24:38.485633+0000 mgr.smithi005.rupoiq (mgr.14195) 185 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:39 smithi157 bash[23502]: audit 2024-03-21T13:24:38.890055+0000 mon.smithi005 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.5:0/3149491211' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-21T13:24:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:39 smithi157 bash[23502]: audit 2024-03-21T13:24:39.511606+0000 mon.smithi005 (mon.0) 711 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:40.254 INFO:teuthology.orchestra.run.smithi005.stdout:90194313244 2024-03-21T13:24:40.335 INFO:teuthology.orchestra.run.smithi005.stdout:85899345948 2024-03-21T13:24:40.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855380 got 150323855383 for osd.7 2024-03-21T13:24:40.577 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:40.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:40 smithi157 bash[23502]: audit 2024-03-21T13:24:40.255409+0000 mon.smithi005 (mon.0) 712 : audit [DBG] from='client.? 172.21.15.5:0/913885944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-21T13:24:40.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:40 smithi157 bash[23502]: audit 2024-03-21T13:24:40.336791+0000 mon.smithi005 (mon.0) 713 : audit [DBG] from='client.? 172.21.15.5:0/4096889755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-21T13:24:40.844 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:40 smithi005 bash[18615]: audit 2024-03-21T13:24:40.255409+0000 mon.smithi005 (mon.0) 712 : audit [DBG] from='client.? 172.21.15.5:0/913885944' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-21T13:24:40.844 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:40 smithi005 bash[18615]: audit 2024-03-21T13:24:40.336791+0000 mon.smithi005 (mon.0) 713 : audit [DBG] from='client.? 172.21.15.5:0/4096889755' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-21T13:24:40.845 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476761 got 68719476765 for osd.0 2024-03-21T13:24:40.845 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:41.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313240 got 90194313244 for osd.2 2024-03-21T13:24:41.736 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:41.749 INFO:tasks.cephadm.ceph_manager.ceph:need seq 85899345943 got 85899345948 for osd.1 2024-03-21T13:24:41.750 DEBUG:teuthology.parallel:result is None 2024-03-21T13:24:41.750 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-21T13:24:41.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-21T13:24:42.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:41 smithi157 bash[23502]: cluster 2024-03-21T13:24:40.485961+0000 mgr.smithi005.rupoiq (mgr.14195) 186 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:42.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:41 smithi005 bash[18615]: cluster 2024-03-21T13:24:40.485961+0000 mgr.smithi005.rupoiq (mgr.14195) 186 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:43.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:42 smithi157 bash[23502]: audit 2024-03-21T13:24:42.680324+0000 mon.smithi005 (mon.0) 714 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:24:43.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:42 smithi005 bash[18615]: audit 2024-03-21T13:24:42.680324+0000 mon.smithi005 (mon.0) 714 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:24:44.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:43 smithi157 bash[23502]: cluster 2024-03-21T13:24:42.486512+0000 mgr.smithi005.rupoiq (mgr.14195) 187 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:44.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:43 smithi005 bash[18615]: cluster 2024-03-21T13:24:42.486512+0000 mgr.smithi005.rupoiq (mgr.14195) 187 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:46.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:45 smithi157 bash[23502]: cluster 2024-03-21T13:24:44.487103+0000 mgr.smithi005.rupoiq (mgr.14195) 188 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:46.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:45 smithi005 bash[18615]: cluster 2024-03-21T13:24:44.487103+0000 mgr.smithi005.rupoiq (mgr.14195) 188 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:46.588 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:48.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:47 smithi157 bash[23502]: cluster 2024-03-21T13:24:46.487699+0000 mgr.smithi005.rupoiq (mgr.14195) 189 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:48.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:47 smithi005 bash[18615]: cluster 2024-03-21T13:24:46.487699+0000 mgr.smithi005.rupoiq (mgr.14195) 189 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:49.373 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:24:49.377 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:48.227648+0000 mon.smithi005 (mon.0) 715 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:48.238167+0000 mon.smithi005 (mon.0) 716 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: cluster 2024-03-21T13:24:48.488070+0000 mgr.smithi005.rupoiq (mgr.14195) 190 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:48.543162+0000 mon.smithi005 (mon.0) 717 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:48.551043+0000 mon.smithi005 (mon.0) 718 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:49.127189+0000 mon.smithi005 (mon.0) 719 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:49.128366+0000 mon.smithi005 (mon.0) 720 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:49.133650+0000 mon.smithi005 (mon.0) 721 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.542 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:49 smithi157 bash[23502]: audit 2024-03-21T13:24:49.137141+0000 mon.smithi005 (mon.0) 722 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:24:49.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:48.227648+0000 mon.smithi005 (mon.0) 715 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:48.238167+0000 mon.smithi005 (mon.0) 716 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: cluster 2024-03-21T13:24:48.488070+0000 mgr.smithi005.rupoiq (mgr.14195) 190 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:49.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:48.543162+0000 mon.smithi005 (mon.0) 717 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:48.551043+0000 mon.smithi005 (mon.0) 718 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:49.127189+0000 mon.smithi005 (mon.0) 719 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:24:49.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:49.128366+0000 mon.smithi005 (mon.0) 720 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:24:49.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:49.133650+0000 mon.smithi005 (mon.0) 721 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:24:49.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:49 smithi005 bash[18615]: audit 2024-03-21T13:24:49.137141+0000 mon.smithi005 (mon.0) 722 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:24:50.105 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-03-21T13:24:48.487923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749928448,"kb_used":229260,"kb_used_data":4748,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749699188,"statfs":{"total":767926730752,"available":767691968512,"internally_reserved":0,"allocated":4861952,"data_stored":3008040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002805"},"pg_stats":[{"pgid":"1.0","version":"30'217","reported_seq":316,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-21T13:22:56.835615+0000","last_change":"2024-03-21T13:22:56.834703+0000","last_active":"2024-03-21T13:22:56.835615+0000","last_peered":"2024-03-21T13:22:56.835615+0000","last_clean":"2024-03-21T13:22:56.835615+0000","last_became_active":"2024-03-21T13:22:56.833663+0000","last_became_peered":"2024-03-21T13:22:56.833663+0000","last_unstale":"2024-03-21T13:22:56.835615+0000","last_undegraded":"2024-03-21T13:22:56.835615+0000","last_fullsized":"2024-03-21T13:22:56.835615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T13:22:35.021348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T13:22:35.021348+0000","last_clean_scrub_stamp":"2024-03-21T13:22:35.021348+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-23T00:20:01.363553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":35,"seq":150323855386,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713080,"statfs":{"total":95990841344,"available":95962193920,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":31,"seq":133143986203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713652,"statfs":{"total":95990841344,"available":95962779648,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":20,"seq":85899345950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93709496,"statfs":{"total":95990841344,"available":95958523904,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476767,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93708916,"statfs":{"total":95990841344,"available":95957929984,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313246,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713652,"statfs":{"total":95990841344,"available":95962779648,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713076,"statfs":{"total":95990841344,"available":95962189824,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713656,"statfs":{"total":95990841344,"available":95962783744,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":31,"seq":133143986203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713660,"statfs":{"total":95990841344,"available":95962787840,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T13:24:50.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph pg dump --format=json 2024-03-21T13:24:50.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:50 smithi157 bash[23502]: audit 2024-03-21T13:24:49.372977+0000 mgr.smithi005.rupoiq (mgr.14195) 191 : audit [DBG] from='client.14450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:24:50.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:50 smithi005 bash[18615]: audit 2024-03-21T13:24:49.372977+0000 mgr.smithi005.rupoiq (mgr.14195) 191 : audit [DBG] from='client.14450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:24:51.541 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:51 smithi157 bash[23502]: cluster 2024-03-21T13:24:50.488575+0000 mgr.smithi005.rupoiq (mgr.14195) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:51.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:51 smithi005 bash[18615]: cluster 2024-03-21T13:24:50.488575+0000 mgr.smithi005.rupoiq (mgr.14195) 192 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:53.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:53 smithi005 bash[18615]: cluster 2024-03-21T13:24:52.489147+0000 mgr.smithi005.rupoiq (mgr.14195) 193 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:54.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:53 smithi157 bash[23502]: cluster 2024-03-21T13:24:52.489147+0000 mgr.smithi005.rupoiq (mgr.14195) 193 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:54.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:54 smithi005 bash[18615]: audit 2024-03-21T13:24:54.512713+0000 mon.smithi005 (mon.0) 723 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:54.906 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:24:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:54 smithi157 bash[23502]: audit 2024-03-21T13:24:54.512713+0000 mon.smithi005 (mon.0) 723 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:24:55.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:55 smithi157 bash[23502]: cluster 2024-03-21T13:24:54.489771+0000 mgr.smithi005.rupoiq (mgr.14195) 194 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:55.822 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:55 smithi005 bash[18615]: cluster 2024-03-21T13:24:54.489771+0000 mgr.smithi005.rupoiq (mgr.14195) 194 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:57.716 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:24:57.718 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-03-21T13:24:57.935 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:57 smithi005 bash[18615]: cluster 2024-03-21T13:24:56.490449+0000 mgr.smithi005.rupoiq (mgr.14195) 195 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:58.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:57 smithi157 bash[23502]: cluster 2024-03-21T13:24:56.490449+0000 mgr.smithi005.rupoiq (mgr.14195) 195 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:24:58.405 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-03-21T13:24:56.490100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749928448,"kb_used":229260,"kb_used_data":4748,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":749699188,"statfs":{"total":767926730752,"available":767691968512,"internally_reserved":0,"allocated":4861952,"data_stored":3008040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003298"},"pg_stats":[{"pgid":"1.0","version":"30'217","reported_seq":316,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-21T13:22:56.835615+0000","last_change":"2024-03-21T13:22:56.834703+0000","last_active":"2024-03-21T13:22:56.835615+0000","last_peered":"2024-03-21T13:22:56.835615+0000","last_clean":"2024-03-21T13:22:56.835615+0000","last_became_active":"2024-03-21T13:22:56.833663+0000","last_became_peered":"2024-03-21T13:22:56.833663+0000","last_unstale":"2024-03-21T13:22:56.835615+0000","last_undegraded":"2024-03-21T13:22:56.835615+0000","last_fullsized":"2024-03-21T13:22:56.835615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-21T13:22:35.021348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-21T13:22:35.021348+0000","last_clean_scrub_stamp":"2024-03-21T13:22:35.021348+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-23T00:20:01.363553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3],"acting":[7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":166,"num_read_kb":145,"num_write":269,"num_write_kb":5026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":35,"seq":150323855387,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713080,"statfs":{"total":95990841344,"available":95962193920,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":31,"seq":133143986204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713652,"statfs":{"total":95990841344,"available":95962779648,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":20,"seq":85899345951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":31560,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93709496,"statfs":{"total":95990841344,"available":95958523904,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476769,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93708916,"statfs":{"total":95990841344,"available":95957929984,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313248,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713652,"statfs":{"total":95990841344,"available":95962779648,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149725,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713076,"statfs":{"total":95990841344,"available":95962189824,"internally_reserved":0,"allocated":978944,"data_stored":744985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":27,"seq":115964117021,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27400,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713656,"statfs":{"total":95990841344,"available":95962783744,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":31,"seq":133143986204,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93741056,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93713660,"statfs":{"total":95990841344,"available":95962787840,"internally_reserved":0,"allocated":385024,"data_stored":154617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-21T13:24:58.406 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-21T13:24:58.406 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-21T13:24:58.406 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-21T13:24:58.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph health --format=json 2024-03-21T13:24:58.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:58 smithi005 bash[18615]: audit 2024-03-21T13:24:57.715313+0000 mgr.smithi005.rupoiq (mgr.14195) 196 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:24:59.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:58 smithi157 bash[23502]: audit 2024-03-21T13:24:57.715313+0000 mgr.smithi005.rupoiq (mgr.14195) 196 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:25:00.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:24:59 smithi157 bash[23502]: cluster 2024-03-21T13:24:58.491067+0000 mgr.smithi005.rupoiq (mgr.14195) 197 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:00.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:24:59 smithi005 bash[18615]: cluster 2024-03-21T13:24:58.491067+0000 mgr.smithi005.rupoiq (mgr.14195) 197 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:01.906 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:01 smithi157 bash[23502]: cluster 2024-03-21T13:25:00.491693+0000 mgr.smithi005.rupoiq (mgr.14195) 198 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:02.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:01 smithi005 bash[18615]: cluster 2024-03-21T13:25:00.491693+0000 mgr.smithi005.rupoiq (mgr.14195) 198 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:03.218 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:04.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:03 smithi157 bash[23502]: cluster 2024-03-21T13:25:02.492261+0000 mgr.smithi005.rupoiq (mgr.14195) 199 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:04.046 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:03 smithi005 bash[18615]: cluster 2024-03-21T13:25:02.492261+0000 mgr.smithi005.rupoiq (mgr.14195) 199 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:05.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:05 smithi157 bash[23502]: cluster 2024-03-21T13:25:04.492839+0000 mgr.smithi005.rupoiq (mgr.14195) 200 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:06.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:05 smithi005 bash[18615]: cluster 2024-03-21T13:25:04.492839+0000 mgr.smithi005.rupoiq (mgr.14195) 200 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:06.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:25:06.079 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-21T13:25:06.743 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-21T13:25:06.743 INFO:tasks.cephadm:Setup complete, yielding 2024-03-21T13:25:06.743 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-21T13:25:06.754 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:25:06.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch status' 2024-03-21T13:25:07.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:06 smithi157 bash[23502]: audit 2024-03-21T13:25:06.080909+0000 mon.smithi005 (mon.0) 724 : audit [DBG] from='client.? 172.21.15.5:0/3579108961' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-21T13:25:07.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:06 smithi005 bash[18615]: audit 2024-03-21T13:25:06.080909+0000 mon.smithi005 (mon.0) 724 : audit [DBG] from='client.? 172.21.15.5:0/3579108961' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-21T13:25:08.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:07 smithi157 bash[23502]: cluster 2024-03-21T13:25:06.493456+0000 mgr.smithi005.rupoiq (mgr.14195) 201 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:08.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:07 smithi005 bash[18615]: cluster 2024-03-21T13:25:06.493456+0000 mgr.smithi005.rupoiq (mgr.14195) 201 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:09.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:09 smithi005 bash[18615]: cluster 2024-03-21T13:25:08.494115+0000 mgr.smithi005.rupoiq (mgr.14195) 202 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:09.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:09 smithi005 bash[18615]: audit 2024-03-21T13:25:09.512714+0000 mon.smithi005 (mon.0) 725 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:10.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:09 smithi157 bash[23502]: cluster 2024-03-21T13:25:08.494115+0000 mgr.smithi005.rupoiq (mgr.14195) 202 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:10.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:09 smithi157 bash[23502]: audit 2024-03-21T13:25:09.512714+0000 mon.smithi005 (mon.0) 725 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:11.565 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:12.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:11 smithi157 bash[23502]: cluster 2024-03-21T13:25:10.494695+0000 mgr.smithi005.rupoiq (mgr.14195) 203 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:12.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:11 smithi005 bash[18615]: cluster 2024-03-21T13:25:10.494695+0000 mgr.smithi005.rupoiq (mgr.14195) 203 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:13.860 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:13 smithi005 bash[18615]: cluster 2024-03-21T13:25:12.495135+0000 mgr.smithi005.rupoiq (mgr.14195) 204 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:13 smithi157 bash[23502]: cluster 2024-03-21T13:25:12.495135+0000 mgr.smithi005.rupoiq (mgr.14195) 204 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:14.264 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-03-21T13:25:14.264 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-03-21T13:25:14.265 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-03-21T13:25:14.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-21T13:25:15.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:15 smithi157 bash[23502]: audit 2024-03-21T13:25:14.265790+0000 mgr.smithi005.rupoiq (mgr.14195) 205 : audit [DBG] from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:15.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:15 smithi157 bash[23502]: cluster 2024-03-21T13:25:14.495669+0000 mgr.smithi005.rupoiq (mgr.14195) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:16.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:15 smithi005 bash[18615]: audit 2024-03-21T13:25:14.265790+0000 mgr.smithi005.rupoiq (mgr.14195) 205 : audit [DBG] from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:16.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:15 smithi005 bash[18615]: cluster 2024-03-21T13:25:14.495669+0000 mgr.smithi005.rupoiq (mgr.14195) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:18.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:17 smithi157 bash[23502]: cluster 2024-03-21T13:25:16.496262+0000 mgr.smithi005.rupoiq (mgr.14195) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:18.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:17 smithi005 bash[18615]: cluster 2024-03-21T13:25:16.496262+0000 mgr.smithi005.rupoiq (mgr.14195) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:19.781 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:20.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:19 smithi157 bash[23502]: cluster 2024-03-21T13:25:18.496862+0000 mgr.smithi005.rupoiq (mgr.14195) 208 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:20.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:19 smithi005 bash[18615]: cluster 2024-03-21T13:25:18.496862+0000 mgr.smithi005.rupoiq (mgr.14195) 208 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:21.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:21 smithi005 bash[18615]: cluster 2024-03-21T13:25:20.497470+0000 mgr.smithi005.rupoiq (mgr.14195) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:22.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:21 smithi157 bash[23502]: cluster 2024-03-21T13:25:20.497470+0000 mgr.smithi005.rupoiq (mgr.14195) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (4m) 33s ago 5m 14.1M - 0.25.0 c8568f914cd2 3c032e61df5a 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter.smithi005 smithi005 running (5m) 33s ago 5m 8340k - 19.0.0-2267-g960fbbe4 19e12293512f c39ba65d62b5 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter.smithi157 smithi157 running (4m) 34s ago 4m 5816k - 19.0.0-2267-g960fbbe4 19e12293512f fe46164193f5 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (5m) 33s ago 5m 7104k - 19.0.0-2267-g960fbbe4 19e12293512f 5d4a60047c70 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi157 smithi157 running (4m) 34s ago 4m 7088k - 19.0.0-2267-g960fbbe4 19e12293512f a2b15c9774eb 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (4m) 33s ago 5m 73.2M - 9.4.12 2bacad6d85d8 34b86abc92a5 2024-03-21T13:25:22.386 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.rupoiq smithi005 *:9283,8765,8443 running (7m) 33s ago 7m 489M - 19.0.0-2267-g960fbbe4 19e12293512f 13e7c7727be9 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi157.xdzklg smithi157 *:8443,9283,8765 running (4m) 34s ago 4m 436M - 19.0.0-2267-g960fbbe4 19e12293512f 479956e1c61c 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (7m) 33s ago 7m 47.2M 2048M 19.0.0-2267-g960fbbe4 19e12293512f da99c9da38f0 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi157 smithi157 running (4m) 34s ago 4m 39.6M 2048M 19.0.0-2267-g960fbbe4 19e12293512f 789ed69fa162 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (5m) 33s ago 5m 8500k - 1.5.0 0da6a335fe13 7e567bc08049 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi157 smithi157 *:9100 running (4m) 34s ago 4m 8307k - 1.5.0 0da6a335fe13 6e525dbc269a 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi157 running (3m) 34s ago 3m 47.0M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 4019966598b2 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (2m) 33s ago 3m 48.3M 3005M 19.0.0-2267-g960fbbe4 19e12293512f 80aeeb30de1b 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi157 running (2m) 34s ago 2m 37.2M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 5492d8e59f30 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (2m) 33s ago 2m 39.6M 3005M 19.0.0-2267-g960fbbe4 19e12293512f fd41be1ca539 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi157 running (2m) 34s ago 2m 34.8M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 87719eb05761 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi005 running (2m) 33s ago 2m 35.6M 3005M 19.0.0-2267-g960fbbe4 19e12293512f 505d01f7228c 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi157 running (2m) 34s ago 2m 36.9M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 0df93e631522 2024-03-21T13:25:22.387 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi005 running (2m) 33s ago 2m 38.1M 3005M 19.0.0-2267-g960fbbe4 19e12293512f f1e401700c29 2024-03-21T13:25:22.388 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (3m) 33s ago 5m 47.2M - 2.43.0 a07b618ecd1d dd3bc74b7914 2024-03-21T13:25:23.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-21T13:25:24.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:23 smithi157 bash[23502]: audit 2024-03-21T13:25:22.350399+0000 mgr.smithi005.rupoiq (mgr.14195) 210 : audit [DBG] from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:24.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:23 smithi157 bash[23502]: cluster 2024-03-21T13:25:22.498090+0000 mgr.smithi005.rupoiq (mgr.14195) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:24.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:23 smithi005 bash[18615]: audit 2024-03-21T13:25:22.350399+0000 mgr.smithi005.rupoiq (mgr.14195) 210 : audit [DBG] from='client.14466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:24.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:23 smithi005 bash[18615]: cluster 2024-03-21T13:25:22.498090+0000 mgr.smithi005.rupoiq (mgr.14195) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:25.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:24 smithi157 bash[23502]: audit 2024-03-21T13:25:24.521415+0000 mon.smithi005 (mon.0) 726 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:25.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:24 smithi005 bash[18615]: audit 2024-03-21T13:25:24.521415+0000 mon.smithi005 (mon.0) 726 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:25.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:25 smithi157 bash[23502]: cluster 2024-03-21T13:25:24.498724+0000 mgr.smithi005.rupoiq (mgr.14195) 212 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:26.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:25 smithi005 bash[18615]: cluster 2024-03-21T13:25:24.498724+0000 mgr.smithi005.rupoiq (mgr.14195) 212 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:27.893 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:27.917 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:27 smithi005 bash[18615]: cluster 2024-03-21T13:25:26.499334+0000 mgr.smithi005.rupoiq (mgr.14195) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:28.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:27 smithi157 bash[23502]: cluster 2024-03-21T13:25:26.499334+0000 mgr.smithi005.rupoiq (mgr.14195) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:29.802 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:29 smithi005 bash[18615]: cluster 2024-03-21T13:25:28.499974+0000 mgr.smithi005.rupoiq (mgr.14195) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:30.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:29 smithi157 bash[23502]: cluster 2024-03-21T13:25:28.499974+0000 mgr.smithi005.rupoiq (mgr.14195) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:30.526 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager ?:9093,9094 1/1 41s ago 6m count:1 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter 2/2 42s ago 6m * 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:crash 2/2 42s ago 6m * 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:grafana ?:3000 1/1 41s ago 6m count:1 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 2/2 42s ago 6m count:2 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:mon 2/2 42s ago 5m smithi005:172.21.15.5=smithi005;smithi157:172.21.15.157=smithi157;count:2 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter ?:9100 2/2 42s ago 6m * 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:osd.all-available-devices 8 42s ago 4m * 2024-03-21T13:25:30.527 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus ?:9095 1/1 41s ago 6m count:1 2024-03-21T13:25:31.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-21T13:25:32.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:31 smithi157 bash[23502]: cluster 2024-03-21T13:25:30.500503+0000 mgr.smithi005.rupoiq (mgr.14195) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:32.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:31 smithi157 bash[23502]: audit 2024-03-21T13:25:30.512331+0000 mgr.smithi005.rupoiq (mgr.14195) 216 : audit [DBG] from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:32.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:31 smithi005 bash[18615]: cluster 2024-03-21T13:25:30.500503+0000 mgr.smithi005.rupoiq (mgr.14195) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:32.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:31 smithi005 bash[18615]: audit 2024-03-21T13:25:30.512331+0000 mgr.smithi005.rupoiq (mgr.14195) 216 : audit [DBG] from='client.14470 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:34.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:33 smithi157 bash[23502]: cluster 2024-03-21T13:25:32.501092+0000 mgr.smithi005.rupoiq (mgr.14195) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:34.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:33 smithi005 bash[18615]: cluster 2024-03-21T13:25:32.501092+0000 mgr.smithi005.rupoiq (mgr.14195) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:35.792 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:35 smithi157 bash[23502]: cluster 2024-03-21T13:25:34.501716+0000 mgr.smithi005.rupoiq (mgr.14195) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:35.959 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:35.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:35 smithi005 bash[18615]: cluster 2024-03-21T13:25:34.501716+0000 mgr.smithi005.rupoiq (mgr.14195) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:37.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:37 smithi005 bash[18615]: cluster 2024-03-21T13:25:36.502348+0000 mgr.smithi005.rupoiq (mgr.14195) 219 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:38.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:37 smithi157 bash[23502]: cluster 2024-03-21T13:25:36.502348+0000 mgr.smithi005.rupoiq (mgr.14195) 219 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:38.561 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-03-21T13:25:38.561 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-03-21T13:25:38.561 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 172.21.15.157 2024-03-21T13:25:38.561 INFO:teuthology.orchestra.run.smithi005.stdout:2 hosts in cluster 2024-03-21T13:25:39.269 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-21T13:25:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:39 smithi157 bash[23502]: cluster 2024-03-21T13:25:38.503008+0000 mgr.smithi005.rupoiq (mgr.14195) 220 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:39 smithi157 bash[23502]: audit 2024-03-21T13:25:38.561728+0000 mgr.smithi005.rupoiq (mgr.14195) 221 : audit [DBG] from='client.14474 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:40.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:39 smithi157 bash[23502]: audit 2024-03-21T13:25:39.521086+0000 mon.smithi005 (mon.0) 727 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:40.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:39 smithi005 bash[18615]: cluster 2024-03-21T13:25:38.503008+0000 mgr.smithi005.rupoiq (mgr.14195) 220 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:40.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:39 smithi005 bash[18615]: audit 2024-03-21T13:25:38.561728+0000 mgr.smithi005.rupoiq (mgr.14195) 221 : audit [DBG] from='client.14474 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:40.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:39 smithi005 bash[18615]: audit 2024-03-21T13:25:39.521086+0000 mon.smithi005 (mon.0) 727 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:42.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:41 smithi157 bash[23502]: cluster 2024-03-21T13:25:40.503615+0000 mgr.smithi005.rupoiq (mgr.14195) 222 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:42.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:41 smithi005 bash[18615]: cluster 2024-03-21T13:25:40.503615+0000 mgr.smithi005.rupoiq (mgr.14195) 222 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:44.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:43 smithi157 bash[23502]: cluster 2024-03-21T13:25:42.504246+0000 mgr.smithi005.rupoiq (mgr.14195) 223 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:44.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:43 smithi005 bash[18615]: cluster 2024-03-21T13:25:42.504246+0000 mgr.smithi005.rupoiq (mgr.14195) 223 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:44.073 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:45.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:45 smithi157 bash[23502]: cluster 2024-03-21T13:25:44.504864+0000 mgr.smithi005.rupoiq (mgr.14195) 224 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:45.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:45 smithi005 bash[18615]: cluster 2024-03-21T13:25:44.504864+0000 mgr.smithi005.rupoiq (mgr.14195) 224 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme1n1 ssd Linux_209da5b01820384eaa4b 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme2n1 ssd Linux_de9c816c5708b23f394f 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme3n1 ssd Linux_3f79570def0c73e10b18 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme4n1 ssd Linux_c04c3b73d59dae425dc2 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme1n1 ssd Linux_8047e1eac342e4fcc295 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme2n1 ssd Linux_682bf8a0c98a24cf6871 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme3n1 ssd Linux_bad7debd1d6537532b71 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme4n1 ssd Linux_440ba9a2ca3e9575c994 89.4G No 2m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:25:47.504 INFO:teuthology.run_tasks:Running task vip.exec... 2024-03-21T13:25:47.518 INFO:tasks.vip:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:25:47.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server' 2024-03-21T13:25:47.533 INFO:teuthology.orchestra.run.smithi005.stderr:+ systemctl stop nfs-server 2024-03-21T13:25:47.666 INFO:tasks.vip:Running commands on role host.b host ubuntu@smithi157.front.sepia.ceph.com 2024-03-21T13:25:47.666 DEBUG:teuthology.orchestra.run.smithi157:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server' 2024-03-21T13:25:47.680 INFO:teuthology.orchestra.run.smithi157.stderr:+ systemctl stop nfs-server 2024-03-21T13:25:47.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:47 smithi005 bash[18615]: cluster 2024-03-21T13:25:46.505295+0000 mgr.smithi005.rupoiq (mgr.14195) 225 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:47.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:47 smithi005 bash[18615]: audit 2024-03-21T13:25:46.866721+0000 mgr.smithi005.rupoiq (mgr.14195) 226 : audit [DBG] from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:47.810 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-21T13:25:47.818 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:25:47.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph nfs cluster create foo' 2024-03-21T13:25:48.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:47 smithi157 bash[23502]: cluster 2024-03-21T13:25:46.505295+0000 mgr.smithi005.rupoiq (mgr.14195) 225 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:48.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:47 smithi157 bash[23502]: audit 2024-03-21T13:25:46.866721+0000 mgr.smithi005.rupoiq (mgr.14195) 226 : audit [DBG] from='client.14478 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:50.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:49 smithi157 bash[23502]: cluster 2024-03-21T13:25:48.506039+0000 mgr.smithi005.rupoiq (mgr.14195) 227 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:50.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:49 smithi157 bash[23502]: audit 2024-03-21T13:25:49.200591+0000 mon.smithi005 (mon.0) 728 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:25:50.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:49 smithi005 bash[18615]: cluster 2024-03-21T13:25:48.506039+0000 mgr.smithi005.rupoiq (mgr.14195) 227 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:50.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:49 smithi005 bash[18615]: audit 2024-03-21T13:25:49.200591+0000 mon.smithi005 (mon.0) 728 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:25:52.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:51 smithi157 bash[23502]: cluster 2024-03-21T13:25:50.506677+0000 mgr.smithi005.rupoiq (mgr.14195) 228 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:52.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:51 smithi005 bash[18615]: cluster 2024-03-21T13:25:50.506677+0000 mgr.smithi005.rupoiq (mgr.14195) 228 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:25:53.899 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:53 smithi005 bash[18615]: cluster 2024-03-21T13:25:52.507265+0000 mgr.smithi005.rupoiq (mgr.14195) 229 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:54.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:53 smithi157 bash[23502]: cluster 2024-03-21T13:25:52.507265+0000 mgr.smithi005.rupoiq (mgr.14195) 229 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:54 smithi157 bash[23502]: audit 2024-03-21T13:25:54.521236+0000 mon.smithi005 (mon.0) 729 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:54 smithi157 bash[23502]: audit 2024-03-21T13:25:54.592065+0000 mon.smithi005 (mon.0) 730 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:54 smithi157 bash[23502]: audit 2024-03-21T13:25:54.597403+0000 mon.smithi005 (mon.0) 731 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:54 smithi157 bash[23502]: audit 2024-03-21T13:25:54.748425+0000 mon.smithi005 (mon.0) 732 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:54 smithi157 bash[23502]: audit 2024-03-21T13:25:54.754604+0000 mon.smithi005 (mon.0) 733 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:54 smithi005 bash[18615]: audit 2024-03-21T13:25:54.521236+0000 mon.smithi005 (mon.0) 729 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:54 smithi005 bash[18615]: audit 2024-03-21T13:25:54.592065+0000 mon.smithi005 (mon.0) 730 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:54 smithi005 bash[18615]: audit 2024-03-21T13:25:54.597403+0000 mon.smithi005 (mon.0) 731 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:54 smithi005 bash[18615]: audit 2024-03-21T13:25:54.748425+0000 mon.smithi005 (mon.0) 732 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:54 smithi005 bash[18615]: audit 2024-03-21T13:25:54.754604+0000 mon.smithi005 (mon.0) 733 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:56.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:55 smithi005 bash[18615]: cluster 2024-03-21T13:25:54.507752+0000 mgr.smithi005.rupoiq (mgr.14195) 230 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:55 smithi005 bash[18615]: audit 2024-03-21T13:25:55.285924+0000 mon.smithi005 (mon.0) 734 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:25:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:55 smithi005 bash[18615]: audit 2024-03-21T13:25:55.287087+0000 mon.smithi005 (mon.0) 735 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:25:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:55 smithi005 bash[18615]: audit 2024-03-21T13:25:55.295955+0000 mon.smithi005 (mon.0) 736 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:56.052 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:55 smithi005 bash[18615]: audit 2024-03-21T13:25:55.303288+0000 mon.smithi005 (mon.0) 737 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:25:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:55 smithi157 bash[23502]: cluster 2024-03-21T13:25:54.507752+0000 mgr.smithi005.rupoiq (mgr.14195) 230 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:55 smithi157 bash[23502]: audit 2024-03-21T13:25:55.285924+0000 mon.smithi005 (mon.0) 734 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:25:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:55 smithi157 bash[23502]: audit 2024-03-21T13:25:55.287087+0000 mon.smithi005 (mon.0) 735 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:25:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:55 smithi157 bash[23502]: audit 2024-03-21T13:25:55.295955+0000 mon.smithi005 (mon.0) 736 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:56.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:55 smithi157 bash[23502]: audit 2024-03-21T13:25:55.303288+0000 mon.smithi005 (mon.0) 737 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:25:57.123 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:56 smithi005 bash[18615]: audit 2024-03-21T13:25:55.372408+0000 mgr.smithi005.rupoiq (mgr.14195) 231 : audit [DBG] from='client.14482 -' entity='client.admin' cmd=[{"prefix": "nfs cluster create", "cluster_id": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:57.123 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:56 smithi005 bash[18615]: audit 2024-03-21T13:25:55.374115+0000 mon.smithi005 (mon.0) 738 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool create", "pool": ".nfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:25:57.123 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:56 smithi005 bash[18615]: audit 2024-03-21T13:25:56.295084+0000 mon.smithi005 (mon.0) 739 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool create", "pool": ".nfs", "yes_i_really_mean_it": true}]': finished 2024-03-21T13:25:57.123 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:56 smithi005 bash[18615]: cluster 2024-03-21T13:25:56.300546+0000 mon.smithi005 (mon.0) 740 : cluster [DBG] osdmap e40: 8 total, 8 up, 8 in 2024-03-21T13:25:57.123 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:56 smithi005 bash[18615]: audit 2024-03-21T13:25:56.303154+0000 mon.smithi005 (mon.0) 741 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2024-03-21T13:25:57.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:56 smithi157 bash[23502]: audit 2024-03-21T13:25:55.372408+0000 mgr.smithi005.rupoiq (mgr.14195) 231 : audit [DBG] from='client.14482 -' entity='client.admin' cmd=[{"prefix": "nfs cluster create", "cluster_id": "foo", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:25:57.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:56 smithi157 bash[23502]: audit 2024-03-21T13:25:55.374115+0000 mon.smithi005 (mon.0) 738 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool create", "pool": ".nfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-21T13:25:57.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:56 smithi157 bash[23502]: audit 2024-03-21T13:25:56.295084+0000 mon.smithi005 (mon.0) 739 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool create", "pool": ".nfs", "yes_i_really_mean_it": true}]': finished 2024-03-21T13:25:57.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:56 smithi157 bash[23502]: cluster 2024-03-21T13:25:56.300546+0000 mon.smithi005 (mon.0) 740 : cluster [DBG] osdmap e40: 8 total, 8 up, 8 in 2024-03-21T13:25:57.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:56 smithi157 bash[23502]: audit 2024-03-21T13:25:56.303154+0000 mon.smithi005 (mon.0) 741 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2024-03-21T13:25:58.131 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: cluster 2024-03-21T13:25:56.508338+0000 mgr.smithi005.rupoiq (mgr.14195) 232 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:58.131 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: cluster 2024-03-21T13:25:57.295114+0000 mon.smithi005 (mon.0) 742 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-21T13:25:58.131 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: audit 2024-03-21T13:25:57.304427+0000 mon.smithi005 (mon.0) 743 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]': finished 2024-03-21T13:25:58.132 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: cluster 2024-03-21T13:25:57.310353+0000 mon.smithi005 (mon.0) 744 : cluster [DBG] osdmap e41: 8 total, 8 up, 8 in 2024-03-21T13:25:58.132 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: audit 2024-03-21T13:25:57.367414+0000 mon.smithi005 (mon.0) 745 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:58.132 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:57 smithi005 bash[18615]: audit 2024-03-21T13:25:57.411509+0000 mon.smithi005 (mon.0) 746 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:25:58.133 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2024-03-21T13:25:58.146 INFO:tasks.cephadm:Waiting for ceph service nfs.foo to start (timeout 300)... 2024-03-21T13:25:58.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch ls -f json 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: cluster 2024-03-21T13:25:56.508338+0000 mgr.smithi005.rupoiq (mgr.14195) 232 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: cluster 2024-03-21T13:25:57.295114+0000 mon.smithi005 (mon.0) 742 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: audit 2024-03-21T13:25:57.304427+0000 mon.smithi005 (mon.0) 743 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]': finished 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: cluster 2024-03-21T13:25:57.310353+0000 mon.smithi005 (mon.0) 744 : cluster [DBG] osdmap e41: 8 total, 8 up, 8 in 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: audit 2024-03-21T13:25:57.367414+0000 mon.smithi005 (mon.0) 745 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:25:58.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:57 smithi157 bash[23502]: audit 2024-03-21T13:25:57.411509+0000 mon.smithi005 (mon.0) 746 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:25:59.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:58 smithi157 bash[23502]: cephadm 2024-03-21T13:25:57.362600+0000 mgr.smithi005.rupoiq (mgr.14195) 233 : cephadm [INF] Saving service nfs.foo spec with placement count:1 2024-03-21T13:25:59.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:58 smithi157 bash[23502]: cluster 2024-03-21T13:25:58.312540+0000 mon.smithi005 (mon.0) 747 : cluster [DBG] osdmap e42: 8 total, 8 up, 8 in 2024-03-21T13:25:59.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:58 smithi005 bash[18615]: cephadm 2024-03-21T13:25:57.362600+0000 mgr.smithi005.rupoiq (mgr.14195) 233 : cephadm [INF] Saving service nfs.foo spec with placement count:1 2024-03-21T13:25:59.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:58 smithi005 bash[18615]: cluster 2024-03-21T13:25:58.312540+0000 mon.smithi005 (mon.0) 747 : cluster [DBG] osdmap e42: 8 total, 8 up, 8 in 2024-03-21T13:26:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:59 smithi157 bash[23502]: cluster 2024-03-21T13:25:58.509062+0000 mgr.smithi005.rupoiq (mgr.14195) 234 : cluster [DBG] pgmap v197: 33 pgs: 6 active+clean, 11 creating+peering, 16 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:26:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:59 smithi157 bash[23502]: cluster 2024-03-21T13:25:59.307139+0000 mon.smithi005 (mon.0) 748 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-21T13:26:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:59 smithi157 bash[23502]: cluster 2024-03-21T13:25:59.307198+0000 mon.smithi005 (mon.0) 749 : cluster [INF] Cluster is now healthy 2024-03-21T13:26:00.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:25:59 smithi157 bash[23502]: cluster 2024-03-21T13:25:59.332432+0000 mon.smithi005 (mon.0) 750 : cluster [DBG] mgrmap e20: smithi005.rupoiq(active, since 5m), standbys: smithi157.xdzklg 2024-03-21T13:26:00.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:59 smithi005 bash[18615]: cluster 2024-03-21T13:25:58.509062+0000 mgr.smithi005.rupoiq (mgr.14195) 234 : cluster [DBG] pgmap v197: 33 pgs: 6 active+clean, 11 creating+peering, 16 unknown; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:26:00.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:59 smithi005 bash[18615]: cluster 2024-03-21T13:25:59.307139+0000 mon.smithi005 (mon.0) 748 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-21T13:26:00.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:59 smithi005 bash[18615]: cluster 2024-03-21T13:25:59.307198+0000 mon.smithi005 (mon.0) 749 : cluster [INF] Cluster is now healthy 2024-03-21T13:26:00.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:25:59 smithi005 bash[18615]: cluster 2024-03-21T13:25:59.332432+0000 mon.smithi005 (mon.0) 750 : cluster [DBG] mgrmap e20: smithi005.rupoiq(active, since 5m), standbys: smithi157.xdzklg 2024-03-21T13:26:02.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:01 smithi157 bash[23502]: cluster 2024-03-21T13:26:00.509788+0000 mgr.smithi005.rupoiq (mgr.14195) 235 : cluster [DBG] pgmap v198: 33 pgs: 22 active+clean, 11 creating+peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:26:02.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:01 smithi005 bash[18615]: cluster 2024-03-21T13:26:00.509788+0000 mgr.smithi005.rupoiq (mgr.14195) 235 : cluster [DBG] pgmap v198: 33 pgs: 22 active+clean, 11 creating+peering; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-03-21T13:26:02.444 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:04.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: cluster 2024-03-21T13:26:02.510226+0000 mgr.smithi005.rupoiq (mgr.14195) 236 : cluster [DBG] pgmap v199: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:02.956286+0000 mon.smithi005 (mon.0) 751 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:02.961550+0000 mon.smithi005 (mon.0) 752 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.408158+0000 mon.smithi005 (mon.0) 753 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.413223+0000 mon.smithi005 (mon.0) 754 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.414299+0000 mon.smithi005 (mon.0) 755 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.414975+0000 mon.smithi005 (mon.0) 756 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.418915+0000 mon.smithi005 (mon.0) 757 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.421957+0000 mon.smithi005 (mon.0) 758 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.434376+0000 mon.smithi005 (mon.0) 759 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.435051+0000 mon.smithi005 (mon.0) 760 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.436937+0000 mon.smithi005 (mon.0) 761 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2024-03-21T13:26:04.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.439067+0000 mon.smithi005 (mon.0) 762 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.441399+0000 mon.smithi005 (mon.0) 763 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.443767+0000 mon.smithi005 (mon.0) 764 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.495442+0000 mon.smithi005 (mon.0) 765 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.497236+0000 mon.smithi005 (mon.0) 766 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.558075+0000 mon.smithi005 (mon.0) 767 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.559790+0000 mon.smithi005 (mon.0) 768 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-21T13:26:04.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:03 smithi157 bash[23502]: audit 2024-03-21T13:26:03.567042+0000 mon.smithi005 (mon.0) 769 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:04.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: cluster 2024-03-21T13:26:02.510226+0000 mgr.smithi005.rupoiq (mgr.14195) 236 : cluster [DBG] pgmap v199: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 0 op/s 2024-03-21T13:26:04.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:02.956286+0000 mon.smithi005 (mon.0) 751 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:02.961550+0000 mon.smithi005 (mon.0) 752 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.408158+0000 mon.smithi005 (mon.0) 753 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.413223+0000 mon.smithi005 (mon.0) 754 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.414299+0000 mon.smithi005 (mon.0) 755 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.414975+0000 mon.smithi005 (mon.0) 756 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.418915+0000 mon.smithi005 (mon.0) 757 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.421957+0000 mon.smithi005 (mon.0) 758 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.434376+0000 mon.smithi005 (mon.0) 759 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.435051+0000 mon.smithi005 (mon.0) 760 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.436937+0000 mon.smithi005 (mon.0) 761 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.439067+0000 mon.smithi005 (mon.0) 762 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.441399+0000 mon.smithi005 (mon.0) 763 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.443767+0000 mon.smithi005 (mon.0) 764 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:04.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.495442+0000 mon.smithi005 (mon.0) 765 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2024-03-21T13:26:04.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.497236+0000 mon.smithi005 (mon.0) 766 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2024-03-21T13:26:04.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.558075+0000 mon.smithi005 (mon.0) 767 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-03-21T13:26:04.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.559790+0000 mon.smithi005 (mon.0) 768 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi005.vfpzoi-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-03-21T13:26:04.303 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:03 smithi005 bash[18615]: audit 2024-03-21T13:26:03.567042+0000 mon.smithi005 (mon.0) 769 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:05.246 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.434823+0000 mgr.smithi005.rupoiq (mgr.14195) 237 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi005.vfpzoi 2024-03-21T13:26:05.246 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.438835+0000 mgr.smithi005.rupoiq (mgr.14195) 238 : cephadm [INF] Ensuring nfs.foo.0 is in the ganesha grace table 2024-03-21T13:26:05.247 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.557527+0000 mgr.smithi005.rupoiq (mgr.14195) 239 : cephadm [INF] Rados config object exists: conf-nfs.foo 2024-03-21T13:26:05.247 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.557639+0000 mgr.smithi005.rupoiq (mgr.14195) 240 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi005.vfpzoi-rgw 2024-03-21T13:26:05.247 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.562015+0000 mgr.smithi005.rupoiq (mgr.14195) 241 : cephadm [WRN] Bind address in nfs.foo.0.0.smithi005.vfpzoi's ganesha conf is defaulting to empty 2024-03-21T13:26:05.247 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:04 smithi005 bash[18615]: cephadm 2024-03-21T13:26:03.568239+0000 mgr.smithi005.rupoiq (mgr.14195) 242 : cephadm [INF] Deploying daemon nfs.foo.0.0.smithi005.vfpzoi on smithi005 2024-03-21T13:26:05.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.434823+0000 mgr.smithi005.rupoiq (mgr.14195) 237 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi005.vfpzoi 2024-03-21T13:26:05.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.438835+0000 mgr.smithi005.rupoiq (mgr.14195) 238 : cephadm [INF] Ensuring nfs.foo.0 is in the ganesha grace table 2024-03-21T13:26:05.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.557527+0000 mgr.smithi005.rupoiq (mgr.14195) 239 : cephadm [INF] Rados config object exists: conf-nfs.foo 2024-03-21T13:26:05.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.557639+0000 mgr.smithi005.rupoiq (mgr.14195) 240 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi005.vfpzoi-rgw 2024-03-21T13:26:05.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.562015+0000 mgr.smithi005.rupoiq (mgr.14195) 241 : cephadm [WRN] Bind address in nfs.foo.0.0.smithi005.vfpzoi's ganesha conf is defaulting to empty 2024-03-21T13:26:05.292 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:04 smithi157 bash[23502]: cephadm 2024-03-21T13:26:03.568239+0000 mgr.smithi005.rupoiq (mgr.14195) 242 : cephadm [INF] Deploying daemon nfs.foo.0.0.smithi005.vfpzoi on smithi005 2024-03-21T13:26:05.742 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:26:05.742 INFO:teuthology.orchestra.run.smithi005.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2024-03-21T13:18:51.968368Z", "last_refresh": "2024-03-21T13:26:03.402300Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"events": ["2024-03-21T13:20:38.892807Z service:ceph-exporter [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2024-03-21T13:18:44.541258Z", "last_refresh": "2024-03-21T13:26:02.948909Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:20:41.736193Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2024-03-21T13:18:42.658148Z", "last_refresh": "2024-03-21T13:26:02.949109Z", "running": 2, "size": 2}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2024-03-21T13:18:48.297084Z", "last_refresh": "2024-03-21T13:26:03.402410Z", "ports": [3000], "running": 1, "size": 1}}, {"events": ["2024-03-21T13:20:46.823204Z service:mgr [INFO] \"service was created\""], "placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-03-21T13:18:40.831612Z", "last_refresh": "2024-03-21T13:26:02.949372Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:20:53.272880Z service:mon [INFO] \"service was created\""], "placement": {"count": 2, "hosts": ["smithi005:172.21.15.5=smithi005", "smithi157:172.21.15.157=smithi157"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-03-21T13:20:25.427417Z", "last_refresh": "2024-03-21T13:26:02.949493Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:26:03.434585Z service:nfs.foo [INFO] \"service was created\""], "placement": {"count": 1}, "service_id": "foo", "service_name": "nfs.foo", "service_type": "nfs", "spec": {"port": 2049}, "status": {"created": "2024-03-21T13:25:57.362626Z", "ports": [2049], "running": 0, "size": 1}}, {"events": ["2024-03-21T13:20:42.921351Z service:node-exporter [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2024-03-21T13:18:50.194152Z", "last_refresh": "2024-03-21T13:26:02.949236Z", "ports": [9100], "running": 2, "size": 2}}, {"events": ["2024-03-21T13:21:20.486244Z service:osd.all-available-devices [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_id": "all-available-devices", "service_name": "osd.all-available-devices", "service_type": "osd", "spec": {"data_devices": {"all": true}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2024-03-21T13:21:20.478893Z", "last_refresh": "2024-03-21T13:26:02.949611Z", "running": 8, "size": 8}}, {"events": ["2024-03-21T13:20:53.282870Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2024-03-21T13:18:46.458475Z", "last_refresh": "2024-03-21T13:26:03.402520Z", "ports": [9095], "running": 1, "size": 1}}] 2024-03-21T13:26:06.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:05 smithi157 bash[23502]: cluster 2024-03-21T13:26:04.511134+0000 mgr.smithi005.rupoiq (mgr.14195) 243 : cluster [DBG] pgmap v200: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 255 B/s wr, 0 op/s 2024-03-21T13:26:06.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:05 smithi005 bash[18615]: cluster 2024-03-21T13:26:04.511134+0000 mgr.smithi005.rupoiq (mgr.14195) 243 : cluster [DBG] pgmap v200: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 127 B/s rd, 255 B/s wr, 0 op/s 2024-03-21T13:26:06.631 INFO:tasks.cephadm:nfs.foo has 0/1 2024-03-21T13:26:06.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:06 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:26:06.967 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:06 smithi005 systemd[1]: /etc/systemd/system/ceph-3164d712-e785-11ee-95cd-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-03-21T13:26:07.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:06 smithi157 bash[23502]: audit 2024-03-21T13:26:05.729160+0000 mgr.smithi005.rupoiq (mgr.14195) 244 : audit [DBG] from='client.14500 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:26:07.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:06 smithi005 bash[18615]: audit 2024-03-21T13:26:05.729160+0000 mgr.smithi005.rupoiq (mgr.14195) 244 : audit [DBG] from='client.14500 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:26:07.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- ceph orch ls -f json 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: cluster 2024-03-21T13:26:06.512026+0000 mgr.smithi005.rupoiq (mgr.14195) 245 : cluster [DBG] pgmap v201: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 111 B/s rd, 222 B/s wr, 0 op/s 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: audit 2024-03-21T13:26:07.015089+0000 mon.smithi005 (mon.0) 770 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: audit 2024-03-21T13:26:07.021975+0000 mon.smithi005 (mon.0) 771 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: audit 2024-03-21T13:26:07.045079+0000 mon.smithi005 (mon.0) 772 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: audit 2024-03-21T13:26:07.074425+0000 mon.smithi005 (mon.0) 773 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:08 smithi157 bash[23502]: audit 2024-03-21T13:26:07.139725+0000 mon.smithi005 (mon.0) 774 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: cluster 2024-03-21T13:26:06.512026+0000 mgr.smithi005.rupoiq (mgr.14195) 245 : cluster [DBG] pgmap v201: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 111 B/s rd, 222 B/s wr, 0 op/s 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: audit 2024-03-21T13:26:07.015089+0000 mon.smithi005 (mon.0) 770 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: audit 2024-03-21T13:26:07.021975+0000 mon.smithi005 (mon.0) 771 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: audit 2024-03-21T13:26:07.045079+0000 mon.smithi005 (mon.0) 772 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: audit 2024-03-21T13:26:07.074425+0000 mon.smithi005 (mon.0) 773 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:08.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:08 smithi005 bash[18615]: audit 2024-03-21T13:26:07.139725+0000 mon.smithi005 (mon.0) 774 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:26:10.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:10 smithi157 bash[23502]: cluster 2024-03-21T13:26:08.512831+0000 mgr.smithi005.rupoiq (mgr.14195) 246 : cluster [DBG] pgmap v202: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 100 B/s rd, 200 B/s wr, 0 op/s 2024-03-21T13:26:10.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:10 smithi157 bash[23502]: audit 2024-03-21T13:26:09.337983+0000 mon.smithi005 (mon.0) 775 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:10.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:10 smithi157 bash[23502]: audit 2024-03-21T13:26:09.522902+0000 mon.smithi005 (mon.0) 776 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:10.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:10 smithi005 bash[18615]: cluster 2024-03-21T13:26:08.512831+0000 mgr.smithi005.rupoiq (mgr.14195) 246 : cluster [DBG] pgmap v202: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 100 B/s rd, 200 B/s wr, 0 op/s 2024-03-21T13:26:10.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:10 smithi005 bash[18615]: audit 2024-03-21T13:26:09.337983+0000 mon.smithi005 (mon.0) 775 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:10.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:10 smithi005 bash[18615]: audit 2024-03-21T13:26:09.522902+0000 mon.smithi005 (mon.0) 776 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:12.164 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:12.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:12 smithi157 bash[23502]: cluster 2024-03-21T13:26:10.513576+0000 mgr.smithi005.rupoiq (mgr.14195) 247 : cluster [DBG] pgmap v203: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:12.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:12 smithi005 bash[18615]: cluster 2024-03-21T13:26:10.513576+0000 mgr.smithi005.rupoiq (mgr.14195) 247 : cluster [DBG] pgmap v203: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:13.908 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: cluster 2024-03-21T13:26:12.514041+0000 mgr.smithi005.rupoiq (mgr.14195) 248 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:13.908 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:12.630461+0000 mon.smithi005 (mon.0) 777 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.908 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:12.636189+0000 mon.smithi005 (mon.0) 778 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.230259+0000 mon.smithi005 (mon.0) 779 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.235690+0000 mon.smithi005 (mon.0) 780 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.236814+0000 mon.smithi005 (mon.0) 781 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.237602+0000 mon.smithi005 (mon.0) 782 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.241875+0000 mon.smithi005 (mon.0) 783 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.244885+0000 mon.smithi005 (mon.0) 784 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.254940+0000 mon.smithi005 (mon.0) 785 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:13.909 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:13 smithi005 bash[18615]: audit 2024-03-21T13:26:13.317033+0000 mon.smithi005 (mon.0) 786 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: cluster 2024-03-21T13:26:12.514041+0000 mgr.smithi005.rupoiq (mgr.14195) 248 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:12.630461+0000 mon.smithi005 (mon.0) 777 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:12.636189+0000 mon.smithi005 (mon.0) 778 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.230259+0000 mon.smithi005 (mon.0) 779 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.235690+0000 mon.smithi005 (mon.0) 780 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.236814+0000 mon.smithi005 (mon.0) 781 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.237602+0000 mon.smithi005 (mon.0) 782 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.241875+0000 mon.smithi005 (mon.0) 783 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.244885+0000 mon.smithi005 (mon.0) 784 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:14.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.254940+0000 mon.smithi005 (mon.0) 785 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:14.042 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:13 smithi157 bash[23502]: audit 2024-03-21T13:26:13.317033+0000 mon.smithi005 (mon.0) 786 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-21T13:26:15.049 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-03-21T13:26:15.050 INFO:teuthology.orchestra.run.smithi005.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2024-03-21T13:18:51.968368Z", "last_refresh": "2024-03-21T13:26:13.224051Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"events": ["2024-03-21T13:20:38.892807Z service:ceph-exporter [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2024-03-21T13:18:44.541258Z", "last_refresh": "2024-03-21T13:26:12.622410Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:20:41.736193Z service:crash [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2024-03-21T13:18:42.658148Z", "last_refresh": "2024-03-21T13:26:12.622583Z", "running": 2, "size": 2}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2024-03-21T13:18:48.297084Z", "last_refresh": "2024-03-21T13:26:13.224174Z", "ports": [3000], "running": 1, "size": 1}}, {"events": ["2024-03-21T13:20:46.823204Z service:mgr [INFO] \"service was created\""], "placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-03-21T13:18:40.831612Z", "last_refresh": "2024-03-21T13:26:12.622857Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:20:53.272880Z service:mon [INFO] \"service was created\""], "placement": {"count": 2, "hosts": ["smithi005:172.21.15.5=smithi005", "smithi157:172.21.15.157=smithi157"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-03-21T13:20:25.427417Z", "last_refresh": "2024-03-21T13:26:12.622987Z", "running": 2, "size": 2}}, {"events": ["2024-03-21T13:26:13.255133Z service:nfs.foo [INFO] \"service was created\""], "placement": {"count": 1}, "service_id": "foo", "service_name": "nfs.foo", "service_type": "nfs", "spec": {"port": 2049}, "status": {"created": "2024-03-21T13:25:57.362626Z", "last_refresh": "2024-03-21T13:26:13.224842Z", "ports": [2049], "running": 1, "size": 1}}, {"events": ["2024-03-21T13:20:42.921351Z service:node-exporter [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2024-03-21T13:18:50.194152Z", "last_refresh": "2024-03-21T13:26:12.622723Z", "ports": [9100], "running": 2, "size": 2}}, {"events": ["2024-03-21T13:21:20.486244Z service:osd.all-available-devices [INFO] \"service was created\""], "placement": {"host_pattern": "*"}, "service_id": "all-available-devices", "service_name": "osd.all-available-devices", "service_type": "osd", "spec": {"data_devices": {"all": true}, "filter_logic": "AND", "objectstore": "bluestore"}, "status": {"created": "2024-03-21T13:21:20.478893Z", "last_refresh": "2024-03-21T13:26:12.623116Z", "running": 8, "size": 8}}, {"events": ["2024-03-21T13:20:53.282870Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2024-03-21T13:18:46.458475Z", "last_refresh": "2024-03-21T13:26:13.224285Z", "ports": [9095], "running": 1, "size": 1}}] 2024-03-21T13:26:15.689 INFO:tasks.cephadm:nfs.foo has 1/1 2024-03-21T13:26:15.690 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-21T13:26:15.701 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:26:15.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'stat -c '"'"'%u %g'"'"' /var/log/ceph | grep '"'"'167 167'"'"'' 2024-03-21T13:26:15.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:15 smithi157 bash[23502]: cluster 2024-03-21T13:26:14.514744+0000 mgr.smithi005.rupoiq (mgr.14195) 249 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:16.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:15 smithi005 bash[18615]: cluster 2024-03-21T13:26:14.514744+0000 mgr.smithi005.rupoiq (mgr.14195) 249 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 682 B/s wr, 1 op/s 2024-03-21T13:26:17.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:16 smithi157 bash[23502]: audit 2024-03-21T13:26:15.045168+0000 mgr.smithi005.rupoiq (mgr.14195) 250 : audit [DBG] from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:26:17.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:16 smithi005 bash[18615]: audit 2024-03-21T13:26:15.045168+0000 mgr.smithi005.rupoiq (mgr.14195) 250 : audit [DBG] from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-21T13:26:18.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:17 smithi157 bash[23502]: cluster 2024-03-21T13:26:16.515420+0000 mgr.smithi005.rupoiq (mgr.14195) 251 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:18.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:17 smithi005 bash[18615]: cluster 2024-03-21T13:26:16.515420+0000 mgr.smithi005.rupoiq (mgr.14195) 251 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: cluster 2024-03-21T13:26:18.516155+0000 mgr.smithi005.rupoiq (mgr.14195) 252 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:18.904763+0000 mon.smithi005 (mon.0) 787 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:18.910193+0000 mon.smithi005 (mon.0) 788 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.360242+0000 mon.smithi005 (mon.0) 789 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.368738+0000 mon.smithi005 (mon.0) 790 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.370502+0000 mon.smithi005 (mon.0) 791 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.371241+0000 mon.smithi005 (mon.0) 792 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.375441+0000 mon.smithi005 (mon.0) 793 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.378782+0000 mon.smithi005 (mon.0) 794 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:20.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:19 smithi157 bash[23502]: audit 2024-03-21T13:26:19.389220+0000 mon.smithi005 (mon.0) 795 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: cluster 2024-03-21T13:26:18.516155+0000 mgr.smithi005.rupoiq (mgr.14195) 252 : cluster [DBG] pgmap v207: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:18.904763+0000 mon.smithi005 (mon.0) 787 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:18.910193+0000 mon.smithi005 (mon.0) 788 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.360242+0000 mon.smithi005 (mon.0) 789 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.368738+0000 mon.smithi005 (mon.0) 790 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.370502+0000 mon.smithi005 (mon.0) 791 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-21T13:26:20.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.371241+0000 mon.smithi005 (mon.0) 792 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-21T13:26:20.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.375441+0000 mon.smithi005 (mon.0) 793 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.378782+0000 mon.smithi005 (mon.0) 794 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-21T13:26:20.302 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:19 smithi005 bash[18615]: audit 2024-03-21T13:26:19.389220+0000 mon.smithi005 (mon.0) 795 : audit [INF] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' 2024-03-21T13:26:20.393 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:22.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:21 smithi157 bash[23502]: cluster 2024-03-21T13:26:20.517006+0000 mgr.smithi005.rupoiq (mgr.14195) 253 : cluster [DBG] pgmap v208: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:22.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:21 smithi005 bash[18615]: cluster 2024-03-21T13:26:20.517006+0000 mgr.smithi005.rupoiq (mgr.14195) 253 : cluster [DBG] pgmap v208: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 511 B/s wr, 1 op/s 2024-03-21T13:26:22.818 INFO:teuthology.orchestra.run.smithi005.stdout:167 167 2024-03-21T13:26:23.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch status' 2024-03-21T13:26:24.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:23 smithi157 bash[23502]: cluster 2024-03-21T13:26:22.517745+0000 mgr.smithi005.rupoiq (mgr.14195) 254 : cluster [DBG] pgmap v209: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:24.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:23 smithi005 bash[18615]: cluster 2024-03-21T13:26:22.517745+0000 mgr.smithi005.rupoiq (mgr.14195) 254 : cluster [DBG] pgmap v209: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:25.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:24 smithi157 bash[23502]: audit 2024-03-21T13:26:24.525345+0000 mon.smithi005 (mon.0) 796 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:25.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:24 smithi005 bash[18615]: audit 2024-03-21T13:26:24.525345+0000 mon.smithi005 (mon.0) 796 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:26.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:25 smithi157 bash[23502]: cluster 2024-03-21T13:26:24.518476+0000 mgr.smithi005.rupoiq (mgr.14195) 255 : cluster [DBG] pgmap v210: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:26.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:25 smithi005 bash[18615]: cluster 2024-03-21T13:26:24.518476+0000 mgr.smithi005.rupoiq (mgr.14195) 255 : cluster [DBG] pgmap v210: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:28.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:27 smithi157 bash[23502]: cluster 2024-03-21T13:26:26.519240+0000 mgr.smithi005.rupoiq (mgr.14195) 256 : cluster [DBG] pgmap v211: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:28.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:27 smithi005 bash[18615]: cluster 2024-03-21T13:26:26.519240+0000 mgr.smithi005.rupoiq (mgr.14195) 256 : cluster [DBG] pgmap v211: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:28.334 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:30.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:29 smithi157 bash[23502]: cluster 2024-03-21T13:26:28.520078+0000 mgr.smithi005.rupoiq (mgr.14195) 257 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:30.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:29 smithi005 bash[18615]: cluster 2024-03-21T13:26:28.520078+0000 mgr.smithi005.rupoiq (mgr.14195) 257 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:31.178 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-03-21T13:26:31.178 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-03-21T13:26:31.178 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-03-21T13:26:31.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-21T13:26:32.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:31 smithi157 bash[23502]: cluster 2024-03-21T13:26:30.520784+0000 mgr.smithi005.rupoiq (mgr.14195) 258 : cluster [DBG] pgmap v213: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:32.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:31 smithi005 bash[18615]: cluster 2024-03-21T13:26:30.520784+0000 mgr.smithi005.rupoiq (mgr.14195) 258 : cluster [DBG] pgmap v213: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:33.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:32 smithi157 bash[23502]: audit 2024-03-21T13:26:31.180276+0000 mgr.smithi005.rupoiq (mgr.14195) 259 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:33.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:32 smithi005 bash[18615]: audit 2024-03-21T13:26:31.180276+0000 mgr.smithi005.rupoiq (mgr.14195) 259 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:34.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:33 smithi157 bash[23502]: cluster 2024-03-21T13:26:32.521515+0000 mgr.smithi005.rupoiq (mgr.14195) 260 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:34.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:33 smithi005 bash[18615]: cluster 2024-03-21T13:26:32.521515+0000 mgr.smithi005.rupoiq (mgr.14195) 260 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:36.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:35 smithi157 bash[23502]: cluster 2024-03-21T13:26:34.522242+0000 mgr.smithi005.rupoiq (mgr.14195) 261 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:36.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:35 smithi005 bash[18615]: cluster 2024-03-21T13:26:34.522242+0000 mgr.smithi005.rupoiq (mgr.14195) 261 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:36.613 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:38.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:37 smithi005 bash[18615]: cluster 2024-03-21T13:26:36.522936+0000 mgr.smithi005.rupoiq (mgr.14195) 262 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:38.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:37 smithi157 bash[23502]: cluster 2024-03-21T13:26:36.522936+0000 mgr.smithi005.rupoiq (mgr.14195) 262 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:39.518 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (5m) 20s ago 6m 13.4M - 0.25.0 c8568f914cd2 3c032e61df5a 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter.smithi005 smithi005 running (7m) 20s ago 7m 8483k - 19.0.0-2267-g960fbbe4 19e12293512f c39ba65d62b5 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter.smithi157 smithi157 running (6m) 20s ago 6m 5816k - 19.0.0-2267-g960fbbe4 19e12293512f fe46164193f5 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (7m) 20s ago 7m 7104k - 19.0.0-2267-g960fbbe4 19e12293512f 5d4a60047c70 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi157 smithi157 running (5m) 20s ago 5m 7088k - 19.0.0-2267-g960fbbe4 19e12293512f a2b15c9774eb 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (5m) 20s ago 6m 73.6M - 9.4.12 2bacad6d85d8 34b86abc92a5 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.rupoiq smithi005 *:9283,8765,8443 running (8m) 20s ago 8m 495M - 19.0.0-2267-g960fbbe4 19e12293512f 13e7c7727be9 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi157.xdzklg smithi157 *:8443,9283,8765 running (5m) 20s ago 5m 437M - 19.0.0-2267-g960fbbe4 19e12293512f 479956e1c61c 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (8m) 20s ago 8m 43.7M 2048M 19.0.0-2267-g960fbbe4 19e12293512f da99c9da38f0 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi157 smithi157 running (5m) 20s ago 5m 34.8M 2048M 19.0.0-2267-g960fbbe4 19e12293512f 789ed69fa162 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:nfs.foo.0.0.smithi005.vfpzoi smithi005 *:2049 running (32s) 20s ago 32s 63.9M - 5.7 19e12293512f ea40a7ff7381 2024-03-21T13:26:39.519 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (7m) 20s ago 7m 8399k - 1.5.0 0da6a335fe13 7e567bc08049 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 20s ago 5m 8544k - 1.5.0 0da6a335fe13 6e525dbc269a 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi157 running (4m) 20s ago 4m 48.3M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 4019966598b2 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 20s ago 4m 50.5M 3005M 19.0.0-2267-g960fbbe4 19e12293512f 80aeeb30de1b 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi157 running (4m) 20s ago 4m 38.4M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 5492d8e59f30 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (4m) 20s ago 4m 42.8M 3005M 19.0.0-2267-g960fbbe4 19e12293512f fd41be1ca539 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi157 running (4m) 20s ago 4m 37.0M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 87719eb05761 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi005 running (4m) 20s ago 4m 38.7M 3005M 19.0.0-2267-g960fbbe4 19e12293512f 505d01f7228c 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi157 running (4m) 20s ago 4m 40.1M 3772M 19.0.0-2267-g960fbbe4 19e12293512f 0df93e631522 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi005 running (3m) 20s ago 3m 40.0M 3005M 19.0.0-2267-g960fbbe4 19e12293512f f1e401700c29 2024-03-21T13:26:39.520 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (5m) 20s ago 6m 49.9M - 2.43.0 a07b618ecd1d dd3bc74b7914 2024-03-21T13:26:40.212 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:39 smithi005 bash[18615]: cluster 2024-03-21T13:26:38.523755+0000 mgr.smithi005.rupoiq (mgr.14195) 263 : cluster [DBG] pgmap v217: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:40.212 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:39 smithi005 bash[18615]: audit 2024-03-21T13:26:39.525700+0000 mon.smithi005 (mon.0) 797 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:40.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-21T13:26:40.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:39 smithi157 bash[23502]: cluster 2024-03-21T13:26:38.523755+0000 mgr.smithi005.rupoiq (mgr.14195) 263 : cluster [DBG] pgmap v217: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:40.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:39 smithi157 bash[23502]: audit 2024-03-21T13:26:39.525700+0000 mon.smithi005 (mon.0) 797 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:41.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:40 smithi157 bash[23502]: audit 2024-03-21T13:26:39.475166+0000 mgr.smithi005.rupoiq (mgr.14195) 264 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:41.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:40 smithi005 bash[18615]: audit 2024-03-21T13:26:39.475166+0000 mgr.smithi005.rupoiq (mgr.14195) 264 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:42.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:41 smithi157 bash[23502]: cluster 2024-03-21T13:26:40.524457+0000 mgr.smithi005.rupoiq (mgr.14195) 265 : cluster [DBG] pgmap v218: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:42.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:41 smithi005 bash[18615]: cluster 2024-03-21T13:26:40.524457+0000 mgr.smithi005.rupoiq (mgr.14195) 265 : cluster [DBG] pgmap v218: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:44.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:43 smithi157 bash[23502]: cluster 2024-03-21T13:26:42.525166+0000 mgr.smithi005.rupoiq (mgr.14195) 266 : cluster [DBG] pgmap v219: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:44.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:43 smithi005 bash[18615]: cluster 2024-03-21T13:26:42.525166+0000 mgr.smithi005.rupoiq (mgr.14195) 266 : cluster [DBG] pgmap v219: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:45.031 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:46.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:45 smithi005 bash[18615]: cluster 2024-03-21T13:26:44.525739+0000 mgr.smithi005.rupoiq (mgr.14195) 267 : cluster [DBG] pgmap v220: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:46.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:45 smithi157 bash[23502]: cluster 2024-03-21T13:26:44.525739+0000 mgr.smithi005.rupoiq (mgr.14195) 267 : cluster [DBG] pgmap v220: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-21T13:26:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager ?:9093,9094 1/1 28s ago 7m count:1 2024-03-21T13:26:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-exporter 2/2 28s ago 8m * 2024-03-21T13:26:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:crash 2/2 28s ago 8m * 2024-03-21T13:26:47.664 INFO:teuthology.orchestra.run.smithi005.stdout:grafana ?:3000 1/1 28s ago 7m count:1 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 2/2 28s ago 8m count:2 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:mon 2/2 28s ago 6m smithi005:172.21.15.5=smithi005;smithi157:172.21.15.157=smithi157;count:2 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:nfs.foo ?:2049 1/1 28s ago 50s count:1 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter ?:9100 2/2 28s ago 7m * 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.all-available-devices 8 28s ago 5m * 2024-03-21T13:26:47.665 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus ?:9095 1/1 28s ago 8m count:1 2024-03-21T13:26:48.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:47 smithi157 bash[23502]: cluster 2024-03-21T13:26:46.526304+0000 mgr.smithi005.rupoiq (mgr.14195) 268 : cluster [DBG] pgmap v221: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:48.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:47 smithi005 bash[18615]: cluster 2024-03-21T13:26:46.526304+0000 mgr.smithi005.rupoiq (mgr.14195) 268 : cluster [DBG] pgmap v221: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:48.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-21T13:26:49.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:48 smithi157 bash[23502]: audit 2024-03-21T13:26:47.648348+0000 mgr.smithi005.rupoiq (mgr.14195) 269 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:49.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:48 smithi005 bash[18615]: audit 2024-03-21T13:26:47.648348+0000 mgr.smithi005.rupoiq (mgr.14195) 269 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:50.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:49 smithi157 bash[23502]: cluster 2024-03-21T13:26:48.526760+0000 mgr.smithi005.rupoiq (mgr.14195) 270 : cluster [DBG] pgmap v222: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:50.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:49 smithi005 bash[18615]: cluster 2024-03-21T13:26:48.526760+0000 mgr.smithi005.rupoiq (mgr.14195) 270 : cluster [DBG] pgmap v222: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:52.252 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:51 smithi005 bash[18615]: cluster 2024-03-21T13:26:50.527419+0000 mgr.smithi005.rupoiq (mgr.14195) 271 : cluster [DBG] pgmap v223: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:52.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:51 smithi157 bash[23502]: cluster 2024-03-21T13:26:50.527419+0000 mgr.smithi005.rupoiq (mgr.14195) 271 : cluster [DBG] pgmap v223: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:53.170 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:26:54.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:54 smithi157 bash[23502]: cluster 2024-03-21T13:26:52.528134+0000 mgr.smithi005.rupoiq (mgr.14195) 272 : cluster [DBG] pgmap v224: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:54.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:54 smithi005 bash[18615]: cluster 2024-03-21T13:26:52.528134+0000 mgr.smithi005.rupoiq (mgr.14195) 272 : cluster [DBG] pgmap v224: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:55.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:55 smithi157 bash[23502]: audit 2024-03-21T13:26:54.526627+0000 mon.smithi005 (mon.0) 798 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:55.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:55 smithi005 bash[18615]: audit 2024-03-21T13:26:54.526627+0000 mon.smithi005 (mon.0) 798 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:26:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-03-21T13:26:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-03-21T13:26:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 172.21.15.157 2024-03-21T13:26:56.110 INFO:teuthology.orchestra.run.smithi005.stdout:2 hosts in cluster 2024-03-21T13:26:56.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:56 smithi157 bash[23502]: cluster 2024-03-21T13:26:54.528818+0000 mgr.smithi005.rupoiq (mgr.14195) 273 : cluster [DBG] pgmap v225: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:56.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:56 smithi005 bash[18615]: cluster 2024-03-21T13:26:54.528818+0000 mgr.smithi005.rupoiq (mgr.14195) 273 : cluster [DBG] pgmap v225: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:26:56.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-21T13:26:58.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:58 smithi157 bash[23502]: audit 2024-03-21T13:26:56.111951+0000 mgr.smithi005.rupoiq (mgr.14195) 274 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:58.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:26:58 smithi157 bash[23502]: cluster 2024-03-21T13:26:56.529493+0000 mgr.smithi005.rupoiq (mgr.14195) 275 : cluster [DBG] pgmap v226: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:26:58.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:58 smithi005 bash[18615]: audit 2024-03-21T13:26:56.111951+0000 mgr.smithi005.rupoiq (mgr.14195) 274 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:26:58.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:26:58 smithi005 bash[18615]: cluster 2024-03-21T13:26:56.529493+0000 mgr.smithi005.rupoiq (mgr.14195) 275 : cluster [DBG] pgmap v226: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:00.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:00 smithi157 bash[23502]: cluster 2024-03-21T13:26:58.530243+0000 mgr.smithi005.rupoiq (mgr.14195) 276 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:00.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:00 smithi005 bash[18615]: cluster 2024-03-21T13:26:58.530243+0000 mgr.smithi005.rupoiq (mgr.14195) 276 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:01.640 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:27:02.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:02 smithi157 bash[23502]: cluster 2024-03-21T13:27:00.530960+0000 mgr.smithi005.rupoiq (mgr.14195) 277 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:02.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:02 smithi005 bash[18615]: cluster 2024-03-21T13:27:00.530960+0000 mgr.smithi005.rupoiq (mgr.14195) 277 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:04.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:04 smithi157 bash[23502]: cluster 2024-03-21T13:27:02.531439+0000 mgr.smithi005.rupoiq (mgr.14195) 278 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:04.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:04 smithi005 bash[18615]: cluster 2024-03-21T13:27:02.531439+0000 mgr.smithi005.rupoiq (mgr.14195) 278 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:04.410 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme1n1 ssd Linux_209da5b01820384eaa4b 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme2n1 ssd Linux_de9c816c5708b23f394f 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme3n1 ssd Linux_3f79570def0c73e10b18 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme4n1 ssd Linux_c04c3b73d59dae425dc2 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme1n1 ssd Linux_8047e1eac342e4fcc295 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme2n1 ssd Linux_682bf8a0c98a24cf6871 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme3n1 ssd Linux_bad7debd1d6537532b71 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:04.411 INFO:teuthology.orchestra.run.smithi005.stdout:smithi157 /dev/nvme4n1 ssd Linux_440ba9a2ca3e9575c994 89.4G No 3m ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-03-21T13:27:05.055 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:960fbbe4645c2becc8084669be194c95183c7753 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3164d712-e785-11ee-95cd-87774f69a715 -- bash -c 'ceph orch ls | grep '"'"'^osd.all-available-devices '"'"'' 2024-03-21T13:27:06.290 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:06 smithi157 bash[23502]: audit 2024-03-21T13:27:04.408551+0000 mgr.smithi005.rupoiq (mgr.14195) 279 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:27:06.291 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:06 smithi157 bash[23502]: cluster 2024-03-21T13:27:04.531868+0000 mgr.smithi005.rupoiq (mgr.14195) 280 : cluster [DBG] pgmap v230: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:27:06.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:06 smithi005 bash[18615]: audit 2024-03-21T13:27:04.408551+0000 mgr.smithi005.rupoiq (mgr.14195) 279 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-21T13:27:06.300 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:06 smithi005 bash[18615]: cluster 2024-03-21T13:27:04.531868+0000 mgr.smithi005.rupoiq (mgr.14195) 280 : cluster [DBG] pgmap v230: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-03-21T13:27:07.540 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:07 smithi157 bash[23502]: cluster 2024-03-21T13:27:06.532491+0000 mgr.smithi005.rupoiq (mgr.14195) 281 : cluster [DBG] pgmap v231: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:07.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:07 smithi005 bash[18615]: cluster 2024-03-21T13:27:06.532491+0000 mgr.smithi005.rupoiq (mgr.14195) 281 : cluster [DBG] pgmap v231: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:09.872 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/mon.smithi005/config 2024-03-21T13:27:09.895 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:09 smithi005 bash[18615]: cluster 2024-03-21T13:27:08.533237+0000 mgr.smithi005.rupoiq (mgr.14195) 282 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:09.895 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:09 smithi005 bash[18615]: audit 2024-03-21T13:27:09.526839+0000 mon.smithi005 (mon.0) 799 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:27:10.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:09 smithi157 bash[23502]: cluster 2024-03-21T13:27:08.533237+0000 mgr.smithi005.rupoiq (mgr.14195) 282 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:10.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:09 smithi157 bash[23502]: audit 2024-03-21T13:27:09.526839+0000 mon.smithi005 (mon.0) 799 : audit [DBG] from='mgr.14195 172.21.15.5:0/967201943' entity='mgr.smithi005.rupoiq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-21T13:27:11.800 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:11 smithi005 bash[18615]: cluster 2024-03-21T13:27:10.533913+0000 mgr.smithi005.rupoiq (mgr.14195) 283 : cluster [DBG] pgmap v233: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:12.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:11 smithi157 bash[23502]: cluster 2024-03-21T13:27:10.533913+0000 mgr.smithi005.rupoiq (mgr.14195) 283 : cluster [DBG] pgmap v233: 33 pgs: 33 active+clean; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-03-21T13:27:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:osd.all-available-devices 8 53s ago 5m * 2024-03-21T13:27:13.193 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-21T13:27:13.203 INFO:tasks.cephadm:Teardown begin 2024-03-21T13:27:13.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:27:13.218 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:27:13.232 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-21T13:27:13.232 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-21T13:27:13.268 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-21T13:27:13.279 INFO:tasks.cephadm:Stopping all daemons... 2024-03-21T13:27:13.279 INFO:tasks.cephadm.mon.smithi005:Stopping mon.smithi005... 2024-03-21T13:27:13.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005 2024-03-21T13:27:13.455 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:13 smithi005 systemd[1]: Stopping Ceph mon.smithi005 for 3164d712-e785-11ee-95cd-87774f69a715... 2024-03-21T13:27:13.585 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:13 smithi005 bash[18615]: debug 2024-03-21T13:27:13.451+0000 7f010905b700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi005 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-21T13:27:13.585 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:13 smithi005 bash[18615]: debug 2024-03-21T13:27:13.451+0000 7f010905b700 -1 mon.smithi005@0(leader) e2 *** Got Signal Terminated *** 2024-03-21T13:27:14.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service' 2024-03-21T13:27:14.340 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:14 smithi005 bash[62779]: ceph-3164d712-e785-11ee-95cd-87774f69a715-mon-smithi005 2024-03-21T13:27:14.340 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:14 smithi005 bash[62873]: Error response from daemon: No such container: ceph-3164d712-e785-11ee-95cd-87774f69a715-mon-smithi005 2024-03-21T13:27:14.340 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:14 smithi005 systemd[1]: ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi005.service: Deactivated successfully. 2024-03-21T13:27:14.340 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Mar 21 13:27:14 smithi005 systemd[1]: Stopped Ceph mon.smithi005 for 3164d712-e785-11ee-95cd-87774f69a715. 2024-03-21T13:27:14.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-21T13:27:14.373 INFO:tasks.cephadm.mon.smithi005:Stopped mon.smithi005 2024-03-21T13:27:14.373 INFO:tasks.cephadm.mon.smithi157:Stopping mon.smithi157... 2024-03-21T13:27:14.373 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi157 2024-03-21T13:27:14.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:14 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for 3164d712-e785-11ee-95cd-87774f69a715... 2024-03-21T13:27:14.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:14 smithi157 bash[23502]: debug 2024-03-21T13:27:14.483+0000 7f6fe6e91700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-21T13:27:14.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Mar 21 13:27:14 smithi157 bash[23502]: debug 2024-03-21T13:27:14.483+0000 7f6fe6e91700 -1 mon.smithi157@1(peon) e2 *** Got Signal Terminated *** 2024-03-21T13:27:15.306 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3164d712-e785-11ee-95cd-87774f69a715@mon.smithi157.service' 2024-03-21T13:27:15.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-21T13:27:15.352 INFO:tasks.cephadm.mon.smithi157:Stopped mon.smithi157 2024-03-21T13:27:15.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3164d712-e785-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-21T13:27:15.534 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:28:12.263 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3164d712-e785-11ee-95cd-87774f69a715 --force --keep-logs 2024-03-21T13:28:12.432 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:28:56.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:28:56.191 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-21T13:28:56.203 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-21T13:28:56.205 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi005/crash 2024-03-21T13:28:56.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash -- . 2024-03-21T13:28:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-21T13:28:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-03-21T13:28:56.248 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi157/crash 2024-03-21T13:28:56.249 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash -- . 2024-03-21T13:28:56.260 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/3164d712-e785-11ee-95cd-87774f69a715/crash: Cannot open: No such file or directory 2024-03-21T13:28:56.260 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-03-21T13:28:56.261 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-21T13:28:56.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-21T13:28:56.303 INFO:teuthology.orchestra.run.smithi005.stdout:2024-03-21T13:25:57.295114+0000 mon.smithi005 (mon.0) 742 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-21T13:28:56.304 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-21T13:28:56.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[SEC\]' /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-21T13:28:56.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]' /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-21T13:28:56.418 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[WRN\]' /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-21T13:28:56.479 INFO:teuthology.orchestra.run.smithi005.stdout:2024-03-21T13:25:57.295114+0000 mon.smithi005 (mon.0) 742 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-21T13:28:56.480 INFO:tasks.cephadm:Compressing logs... 2024-03-21T13:28:56.480 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-21T13:28:56.525 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-21T13:28:56.533 INFO:teuthology.orchestra.run.smithi005.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-21T13:28:56.539 INFO:teuthology.orchestra.run.smithi157.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-03-21T13:28:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-21T13:28:56.542 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi005.log 2024-03-21T13:28:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.7.log 2024-03-21T13:28:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi005.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi005.rupoiq.log 2024-03-21T13:28:56.543 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-21T13:28:56.544 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.7.log: /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi005.rupoiq.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.3.log 2024-03-21T13:28:56.544 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.5.log 2024-03-21T13:28:56.545 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-21T13:28:56.546 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.3.log: -5 --verbose 83.4% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-21T13:28:56.546 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.1.log 2024-03-21T13:28:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi005.log 2024-03-21T13:28:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log 2024-03-21T13:28:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi005.log: 94.0% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi005.log.gz 2024-03-21T13:28:56.548 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.0.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.2.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.6.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi157.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi157.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi157.xdzklg.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi157.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi157.xdzklg.log: 81.6% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.cephadm.log.gz 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr: 89.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-21T13:28:56.551 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi157.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log 2024-03-21T13:28:56.552 INFO:teuthology.orchestra.run.smithi157.stderr: 31.3%/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log: -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-client.ceph-exporter.smithi157.log.gz 2024-03-21T13:28:56.552 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-21T13:28:56.552 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.4.log 2024-03-21T13:28:56.552 INFO:teuthology.orchestra.run.smithi157.stderr: 88.0% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-21T13:28:56.553 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log: /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.4.log: 91.3% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-21T13:28:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log: 87.9% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.log.gz 2024-03-21T13:28:56.553 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log 2024-03-21T13:28:56.553 INFO:teuthology.orchestra.run.smithi157.stderr: 92.0% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi157.xdzklg.log.gz 2024-03-21T13:28:56.562 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-21T13:28:56.565 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log: /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log: 91.2% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph.audit.log.gz 2024-03-21T13:28:56.566 INFO:teuthology.orchestra.run.smithi005.stderr: 91.3% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-volume.log.gz 2024-03-21T13:28:56.579 INFO:teuthology.orchestra.run.smithi005.stderr: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-21T13:28:56.624 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.2.log.gz 2024-03-21T13:28:56.625 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi157.log.gz 2024-03-21T13:28:56.629 INFO:teuthology.orchestra.run.smithi157.stderr: 92.7% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.6.log.gz 2024-03-21T13:28:56.647 INFO:teuthology.orchestra.run.smithi005.stderr: 92.8% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.5.log.gz 2024-03-21T13:28:56.649 INFO:teuthology.orchestra.run.smithi157.stderr: 92.6% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.4.log.gz 2024-03-21T13:28:56.656 INFO:teuthology.orchestra.run.smithi005.stderr: 92.7% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.7.log.gz 2024-03-21T13:28:56.662 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mgr.smithi005.rupoiq.log.gz 2024-03-21T13:28:56.671 INFO:teuthology.orchestra.run.smithi157.stderr: 93.0% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.0.log.gz 2024-03-21T13:28:56.673 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-03-21T13:28:56.673 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.143s 2024-03-21T13:28:56.673 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m0.484s 2024-03-21T13:28:56.673 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.032s 2024-03-21T13:28:56.673 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.3.log.gz 2024-03-21T13:28:56.689 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-osd.1.log.gz 2024-03-21T13:28:56.814 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/3164d712-e785-11ee-95cd-87774f69a715/ceph-mon.smithi005.log.gz 2024-03-21T13:28:56.816 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-03-21T13:28:56.816 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.290s 2024-03-21T13:28:56.816 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m0.914s 2024-03-21T13:28:56.816 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.043s 2024-03-21T13:28:56.817 INFO:tasks.cephadm:Archiving logs... 2024-03-21T13:28:56.817 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi005/log 2024-03-21T13:28:56.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-21T13:28:56.986 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi157/log 2024-03-21T13:28:56.988 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-21T13:28:57.061 INFO:tasks.cephadm:Removing cluster... 2024-03-21T13:28:57.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3164d712-e785-11ee-95cd-87774f69a715 --force 2024-03-21T13:28:57.227 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:28:58.348 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3164d712-e785-11ee-95cd-87774f69a715 --force 2024-03-21T13:28:58.513 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 3164d712-e785-11ee-95cd-87774f69a715 2024-03-21T13:28:59.638 INFO:tasks.cephadm:Removing cephadm ... 2024-03-21T13:28:59.638 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-21T13:28:59.645 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-21T13:28:59.651 INFO:tasks.cephadm:Teardown complete 2024-03-21T13:28:59.651 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2024-03-21T13:28:59.664 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi005:/dev/vg_nvme/lv_1... 2024-03-21T13:28:59.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo nvme disconnect -n lv_1 2024-03-21T13:28:59.939 INFO:teuthology.orchestra.run.smithi005.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-03-21T13:28:59.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:28:59.941 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi005:/dev/vg_nvme/lv_2... 2024-03-21T13:28:59.941 DEBUG:teuthology.orchestra.run.smithi005:> sudo nvme disconnect -n lv_2 2024-03-21T13:29:00.207 INFO:teuthology.orchestra.run.smithi005.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-03-21T13:29:00.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:00.209 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi005:/dev/vg_nvme/lv_3... 2024-03-21T13:29:00.209 DEBUG:teuthology.orchestra.run.smithi005:> sudo nvme disconnect -n lv_3 2024-03-21T13:29:00.499 INFO:teuthology.orchestra.run.smithi005.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-03-21T13:29:00.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:00.501 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi005:/dev/vg_nvme/lv_4... 2024-03-21T13:29:00.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo nvme disconnect -n lv_4 2024-03-21T13:29:00.787 INFO:teuthology.orchestra.run.smithi005.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-03-21T13:29:00.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:00.788 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-03-21T13:29:00.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/scratch_devs 2024-03-21T13:29:00.802 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi157:/dev/vg_nvme/lv_1... 2024-03-21T13:29:00.802 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme disconnect -n lv_1 2024-03-21T13:29:01.038 INFO:teuthology.orchestra.run.smithi157.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-03-21T13:29:01.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:01.040 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi157:/dev/vg_nvme/lv_2... 2024-03-21T13:29:01.040 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme disconnect -n lv_2 2024-03-21T13:29:01.290 INFO:teuthology.orchestra.run.smithi157.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-03-21T13:29:01.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:01.291 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi157:/dev/vg_nvme/lv_3... 2024-03-21T13:29:01.292 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme disconnect -n lv_3 2024-03-21T13:29:01.586 INFO:teuthology.orchestra.run.smithi157.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-03-21T13:29:01.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:01.588 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi157:/dev/vg_nvme/lv_4... 2024-03-21T13:29:01.588 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme disconnect -n lv_4 2024-03-21T13:29:01.866 INFO:teuthology.orchestra.run.smithi157.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-03-21T13:29:01.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:01.867 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-21T13:29:01.868 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/scratch_devs 2024-03-21T13:29:01.881 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-21T13:29:01.891 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-21T13:29:01.891 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T13:29:01.894 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-21T13:29:01.906 INFO:teuthology.orchestra.run.smithi005.stdout: remote refid st t when poll reach delay offset jitter 2024-03-21T13:29:01.906 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================== 2024-03-21T13:29:01.906 INFO:teuthology.orchestra.run.smithi005.stdout:*hv01.front.sepi 44.4.53.2 2 u 45 64 377 0.060 -2.732 1.413 2024-03-21T13:29:01.906 INFO:teuthology.orchestra.run.smithi005.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.064 +0.296 1.135 2024-03-21T13:29:01.906 INFO:teuthology.orchestra.run.smithi005.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.097 -1.456 1.165 2024-03-21T13:29:01.907 INFO:teuthology.orchestra.run.smithi005.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout: remote refid st t when poll reach delay offset jitter 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================== 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 64 377 0.115 -2.240 2.058 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 377 0.071 -1.069 1.364 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.098 -2.143 1.165 2024-03-21T13:29:01.940 INFO:teuthology.orchestra.run.smithi157.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-03-21T13:29:01.941 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-21T13:29:01.951 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-21T13:29:01.952 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-21T13:29:01.961 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-21T13:29:01.970 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-21T13:29:01.979 INFO:teuthology.task.internal:Duration was 1204.425198 seconds 2024-03-21T13:29:01.980 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-21T13:29:01.989 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-21T13:29:01.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-21T13:29:01.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-21T13:29:02.029 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-21T13:29:02.029 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-03-21T13:29:02.030 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-21T13:29:02.084 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-03-21T13:29:02.085 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-21T13:29:02.095 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-21T13:29:02.095 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-21T13:29:02.128 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-21T13:29:02.172 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-21T13:29:02.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-21T13:29:02.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-21T13:29:02.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-21T13:29:02.331 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-21T13:29:02.331 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-21T13:29:02.344 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-21T13:29:02.355 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-21T13:29:02.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-21T13:29:02.388 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-21T13:29:02.396 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-03-21T13:29:02.406 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-03-21T13:29:02.440 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-21T13:29:02.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:02.463 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-21T13:29:02.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-21T13:29:02.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-21T13:29:02.496 INFO:teuthology.task.internal:Transferring archived files... 2024-03-21T13:29:02.497 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi005 2024-03-21T13:29:02.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-21T13:29:02.529 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993/remote/smithi157 2024-03-21T13:29:02.529 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-21T13:29:02.551 INFO:teuthology.task.internal:Removing archive directory... 2024-03-21T13:29:02.551 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-21T13:29:02.568 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-21T13:29:02.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-21T13:29:02.605 INFO:teuthology.task.internal:Not uploading archives. 2024-03-21T13:29:02.605 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-21T13:29:02.615 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-21T13:29:02.615 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-21T13:29:02.618 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-21T13:29:02.622 INFO:teuthology.orchestra.run.smithi005.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 21 13:29 /home/ubuntu/cephtest 2024-03-21T13:29:02.642 INFO:teuthology.orchestra.run.smithi157.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 21 13:29 /home/ubuntu/cephtest 2024-03-21T13:29:02.644 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-21T13:29:02.662 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-21T13:29:02.690 INFO:teuthology.nuke:Checking targets against current locks 2024-03-21T13:29:02.720 DEBUG:teuthology.nuke:shortname: smithi005 2024-03-21T13:29:02.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T13:29:02.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 12:58:12.979194', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkgtbdm8AHLG0deIjmwT8wcSMxNx13Xr4FwPVu6l0sFDGF4VlyB8nGetijHW7PPrH5Cir8+m4EBpeBalwuuejg='} 2024-03-21T13:29:02.753 DEBUG:teuthology.nuke:shortname: smithi157 2024-03-21T13:29:02.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-21T13:29:02.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-03-21_12:04:17-orch:cephadm-wip-guits-testing-2024-03-21-0818-distro-default-smithi/7614993', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-21 12:58:12.977309', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCiYO9FrwthJrpPsJ2UAsW7bbQoQdpWAer4nQQ+BA2Db6ucr1LbmxmGP+oDcvRDHuUgBnoj7tKia4WckmIiZW1o='} 2024-03-21T13:29:02.806 INFO:teuthology.orchestra.console.smithi005:Power off 2024-03-21T13:29:02.806 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T13:29:02.829 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-03-21T13:29:02.829 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:02.845 INFO:teuthology.orchestra.console.smithi157:Power off 2024-03-21T13:29:02.845 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T13:29:02.854 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-21T13:29:02.868 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-03-21T13:29:02.868 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:02.890 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-21T13:29:06.856 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:06.891 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:06.966 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-21T13:29:06.999 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-21T13:29:10.970 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:11.001 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:11.080 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-21T13:29:11.110 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-21T13:29:11.181 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-03-21T13:29:15.115 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:29:15.225 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-03-21T13:29:15.326 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-03-21T13:29:15.430 INFO:teuthology.run:Summary data: description: orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} duration: 1204.425197839737 failure_reason: '"2024-03-21T13:25:57.295114+0000 mon.smithi005 (mon.0) 742 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' owner: scheduled_gabrioux@teuthology success: false 2024-03-21T13:29:15.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:29:15.528 INFO:teuthology.run:FAIL