2024-09-06T14:48:51.507 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-06T14:48:51.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-06T14:48:51.619 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417 branch: wip-athakkar-testing-2024-09-04-1837 description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} email: adking@redhat.com first_in_suite: false job_id: '7892417' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-athakkar-testing-2024-09-04-1837 ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - CEPHADM_STRAY_DAEMON log-only-match: - CEPHADM_ mon_bind_msgr2: false sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 workunit: branch: wip-athakkar-testing-2024-09-04-1837 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 owner: scheduled_adking@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 9103 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 sleep_before_teardown: 0 subset: 1/20 suite: orch:cephadm suite_branch: wip-athakkar-testing-2024-09-04-1837 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 targets: smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLf+3n7pMkqFhk3f+XHMNpYoJu6U86YieH0Z4ox8Q15D0+/9iiG02BVhuGDj0ZQJOOkC+/pvfW/Vzw24jOBJBrQ= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGBv9NSn0HUQ/vj8UL3bBJy/M9iiPPgRTGb0RepziMLsMtt02Q8ix104Ex5H3UE8QRpeUEYhGRABrsMoM0uE8Us= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-06_13:43:09 tube: smithi user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-06T14:48:51.695 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa; will attempt to use it 2024-09-06T14:48:51.696 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks 2024-09-06T14:48:51.696 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-06T14:48:51.697 INFO:teuthology.task.internal:Checking packages... 2024-09-06T14:48:51.719 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73' 2024-09-06T14:48:51.719 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:48:51.719 INFO:teuthology.packaging:ref: None 2024-09-06T14:48:51.719 INFO:teuthology.packaging:tag: None 2024-09-06T14:48:51.719 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:48:51.719 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:51.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:48:51.864 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4704-g8b38c33c-1jammy 2024-09-06T14:48:51.867 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-06T14:48:51.874 INFO:teuthology.task.internal:no buildpackages task found 2024-09-06T14:48:51.874 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-06T14:48:51.884 INFO:teuthology.task.internal:Saving configuration 2024-09-06T14:48:51.896 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-06T14:48:51.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-06T14:48:51.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-06 14:43:07.077670', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMrAfujWJbaw5owhfX39ZIq7T26GWuFw8TzPxAStBDcq'} 2024-09-06T14:48:51.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-06 14:43:07.076020', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBhFSiGPsCYyEeEO7qi4AQKrMU/Y3iCQ10asek40xTmh'} 2024-09-06T14:48:51.967 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-06T14:48:51.973 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-06T14:48:51.973 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-06T14:48:51.973 INFO:teuthology.run_tasks:Running task console_log... 2024-09-06T14:48:52.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa31665bac0>, signals=[15]) 2024-09-06T14:48:52.051 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-06T14:48:52.057 INFO:teuthology.task.internal:Opening connections... 2024-09-06T14:48:52.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-06T14:48:52.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:48:52.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-09-06T14:48:52.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:48:52.237 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-06T14:48:52.245 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-06T14:48:52.250 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-06T14:48:52.250 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Ubuntu" 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="22.04" 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_CODENAME=jammy 2024-09-06T14:48:52.296 INFO:teuthology.orchestra.run.smithi189.stdout:ID=ubuntu 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE=debian 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-06T14:48:52.297 INFO:teuthology.orchestra.run.smithi189.stdout:UBUNTU_CODENAME=jammy 2024-09-06T14:48:52.297 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-06T14:48:52.329 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-09-06T14:48:52.333 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-09-06T14:48:52.334 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-09-06T14:48:52.378 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-06T14:48:52.379 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2024-09-06T14:48:52.380 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-09-06T14:48:52.412 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-06T14:48:52.422 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-06T14:48:52.470 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-06T14:48:52.573 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-06T14:48:52.575 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-09-06T14:48:52.580 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-06T14:48:52.589 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-06T14:48:52.589 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-06T14:48:52.621 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-09-06T14:48:52.636 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-06T14:48:52.699 INFO:teuthology.run_tasks:Running task kernel... 2024-09-06T14:48:52.720 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-06T14:48:52.720 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-06T14:48:52.721 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-06T14:48:52.722 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-06T14:48:52.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:48:52.727 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-06T14:48:52.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:48:52.729 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-06T14:48:52.775 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2024-09-06T14:48:52.776 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.15.0-56-generic 2024-09-06T14:48:52.776 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-06T14:48:52.777 INFO:teuthology.orchestra.run.smithi189.stdout:5.15.0-56-generic 2024-09-06T14:48:52.777 INFO:teuthology.task.kernel:Running kernel on smithi189: 5.15.0-56-generic 2024-09-06T14:48:52.777 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-09-06T14:48:52.898 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-06T14:48:52.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-06T14:48:53.062 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:48:53.076 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-06T14:48:53.145 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-06T14:48:53.177 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-06T14:48:53.222 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:48:53.222 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-06T14:48:53.277 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-06T14:48:53.311 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-06T14:48:53.394 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-06T14:48:53.429 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-06T14:48:53.431 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-06T14:48:53.431 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-06T14:48:53.447 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-06T14:48:53.448 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-06T14:48:53.451 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-06T14:48:53.451 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-06T14:48:53.455 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-06T14:48:53.463 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-06T14:48:53.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-06T14:48:53.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-06T14:48:53.465 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-06T14:48:53.481 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-06T14:48:53.481 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-06T14:48:53.482 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-06T14:48:53.482 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-06T14:48:53.483 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-06T14:48:53.484 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-06T14:48:53.484 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-06T14:48:53.499 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-06T14:48:53.499 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-06T14:48:53.500 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-06T14:48:53.624 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-06T14:48:53.632 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-06T14:48:53.658 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-06T14:48:53.770 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-06T14:48:53.954 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-06T14:48:53.964 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-06T14:48:54.041 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-06T14:48:54.057 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-06T14:48:54.066 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-06T14:48:54.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-06T14:48:54.068 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-06T14:48:54.122 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-06T14:48:54.127 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-06T14:48:54.136 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-06T14:48:54.137 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-06T14:48:54.138 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-06T14:48:54.139 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-06T14:48:54.140 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-06T14:48:54.163 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-06T14:48:54.175 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-06T14:48:54.175 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-06T14:48:54.191 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-06T14:48:54.216 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-06T14:48:54.219 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-06T14:48:54.222 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-06T14:48:54.224 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-06T14:48:54.224 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-06T14:48:54.225 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-06T14:48:54.226 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-06T14:48:54.226 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-06T14:48:54.226 INFO:teuthology.orchestra.run.smithi189.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-06T14:48:54.248 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-06T14:48:54.248 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-06T14:48:54.255 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-06T14:48:54.256 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-06T14:48:54.267 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-06T14:48:54.274 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-06T14:48:54.280 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-06T14:48:54.286 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-06T14:48:54.287 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-06T14:48:54.288 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-06T14:48:54.288 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-06T14:48:54.291 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-06T14:48:54.291 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-06T14:48:54.292 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-06T14:48:54.306 INFO:teuthology.orchestra.run.smithi189.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-06T14:48:54.362 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-06T14:48:54.363 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-06T14:48:54.364 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-06T14:48:54.365 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-06T14:48:54.366 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-06T14:48:54.368 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-06T14:48:54.369 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-06T14:48:54.372 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-06T14:48:54.372 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-06T14:48:54.450 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-06T14:48:54.450 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-06T14:48:59.743 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 15.8 MB in 2s (7,344 kB/s) 2024-09-06T14:49:00.260 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 15.8 MB in 3s (5,812 kB/s) 2024-09-06T14:49:01.136 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:49:01.154 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-06T14:49:01.216 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:49:01.426 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-06T14:49:01.426 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-06T14:49:01.602 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:49:01.603 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:49:01.603 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:49:01.603 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:49:01.603 INFO:teuthology.orchestra.run.smithi189.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-06T14:49:01.603 INFO:teuthology.orchestra.run.smithi189.stdout: python2.7-minimal 2024-09-06T14:49:01.604 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:49:01.604 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-09-06T14:49:01.605 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-06T14:49:01.605 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-06T14:49:01.605 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-06T14:49:01.606 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-09-06T14:49:01.606 INFO:teuthology.orchestra.run.smithi189.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-06T14:49:01.606 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-09-06T14:49:01.606 INFO:teuthology.orchestra.run.smithi189.stdout: thermald 2024-09-06T14:49:01.654 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-09-06T14:49:01.794 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-06T14:49:01.794 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-06T14:49:01.795 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages will be upgraded: 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 113 MB of archives. 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-06T14:49:01.796 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:49:01.797 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-06T14:49:01.866 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:49:02.074 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-06T14:49:02.075 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-06T14:49:02.143 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-06T14:49:02.240 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-06T14:49:02.261 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:49:02.261 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:49:02.261 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:49:02.262 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:49:02.262 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-06T14:49:02.262 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-09-06T14:49:02.262 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:49:02.263 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-06T14:49:02.263 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-06T14:49:02.263 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-06T14:49:02.264 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-06T14:49:02.265 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-06T14:49:02.265 INFO:teuthology.orchestra.run.smithi190.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-06T14:49:02.266 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-06T14:49:02.266 INFO:teuthology.orchestra.run.smithi190.stdout: thermald 2024-09-06T14:49:02.322 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-06T14:49:02.322 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-06T14:49:02.322 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-06T14:49:02.323 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-06T14:49:02.324 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-09-06T14:49:02.324 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-06T14:49:02.505 INFO:teuthology.orchestra.run.smithi190.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-06T14:49:02.505 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 113 MB of archives. 2024-09-06T14:49:02.505 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-06T14:49:02.505 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-06T14:49:03.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-06T14:49:03.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-06T14:49:03.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-06T14:49:03.201 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-06T14:49:03.223 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-06T14:49:03.608 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 113 MB in 2s (72.7 MB/s) 2024-09-06T14:49:03.785 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-06T14:49:03.911 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-06T14:49:04.261 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-06T14:49:05.790 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-06T14:49:05.794 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:05.857 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:06.426 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-06T14:49:06.426 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-06T14:49:06.426 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-06T14:49:06.768 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-06T14:49:06.848 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-06T14:49:07.244 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 113 MB in 5s (25.1 MB/s) 2024-09-06T14:49:07.426 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-06T14:49:08.083 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-06T14:49:08.105 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:08.200 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:08.661 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-06T14:49:08.682 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:08.719 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:09.391 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-06T14:49:09.395 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:09.489 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:11.698 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-06T14:49:11.719 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:11.799 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:12.217 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-06T14:49:12.294 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:12.294 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:14.963 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:15.073 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:15.415 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:15.544 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:15.839 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-06T14:49:15.861 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-06T14:49:15.905 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-06T14:49:19.192 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:19.317 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:19.633 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:19.764 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:20.056 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-06T14:49:20.079 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-06T14:49:20.114 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-06T14:49:21.525 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-06T14:49:21.562 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:21.601 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:24.197 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:24.321 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:24.638 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-06T14:49:24.759 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:24.885 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-06T14:49:25.014 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:25.398 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-06T14:49:25.435 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-06T14:49:25.489 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:26.338 INFO:teuthology.orchestra.run.smithi189.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:26.338 INFO:teuthology.orchestra.run.smithi189.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:26.338 INFO:teuthology.orchestra.run.smithi189.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:26.338 INFO:teuthology.orchestra.run.smithi189.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:26.503 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:27.874 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:29.509 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-06T14:49:29.584 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-06T14:49:29.635 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-06T14:49:29.710 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-06T14:49:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:29.892 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-06T14:49:29.976 INFO:teuthology.orchestra.run.smithi189.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:29.976 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-06T14:49:30.065 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:30.191 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-06T14:49:30.328 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:31.648 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:31.649 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:31.649 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:31.649 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:31.830 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:33.265 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:35.367 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-06T14:49:35.509 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-06T14:49:35.660 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-06T14:49:35.730 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-06T14:49:35.730 INFO:teuthology.orchestra.run.smithi190.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:43.999 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-06T14:49:43.999 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub' 2024-09-06T14:49:44.009 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-06T14:49:44.032 INFO:teuthology.orchestra.run.smithi189.stdout:Generating grub configuration file ... 2024-09-06T14:49:44.300 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:44.324 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:44.593 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:44.599 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:44.666 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-06T14:49:44.672 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-06T14:49:44.832 INFO:teuthology.orchestra.run.smithi189.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-06T14:49:44.832 INFO:teuthology.orchestra.run.smithi189.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-06T14:49:44.832 INFO:teuthology.orchestra.run.smithi189.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-06T14:49:44.871 INFO:teuthology.orchestra.run.smithi189.stdout:done 2024-09-06T14:49:45.365 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-09-06T14:49:45.382 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 21 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.15.0.119.119 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-09-06T14:49:45.383 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-09-06T14:49:45.384 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-09-06T14:49:45.384 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-09-06T14:49:45.384 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-06T14:49:45.384 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-06T14:49:45.384 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-06T14:49:45.384 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-06T14:49:45.384 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=None, version=distro) 2024-09-06T14:49:45.384 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-09-06T14:49:45.566 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-06T14:49:45.695 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-06T14:49:45.695 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:49:45.695 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-06T14:49:45.712 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-06T14:49:47.044 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:49:47.063 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-06T14:49:47.125 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:49:47.336 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-06T14:49:47.336 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-06T14:49:47.514 INFO:teuthology.orchestra.run.smithi189.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-06T14:49:47.515 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:49:47.515 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:49:47.515 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:49:47.515 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:49:47.515 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-06T14:49:47.516 INFO:teuthology.orchestra.run.smithi189.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-06T14:49:47.516 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:49:47.556 INFO:teuthology.orchestra.run.smithi189.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-06T14:49:47.558 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 21 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.15.0.119.119 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-06T14:49:47.574 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-06T14:49:47.575 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-09-06T14:49:47.575 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-09-06T14:49:47.575 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-09-06T14:49:47.575 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-09-06T14:49:47.575 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-06T14:49:47.622 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.QiaIvqgHdx 2024-09-06T14:49:47.623 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QiaIvqgHdx 2024-09-06T14:49:47.678 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.QiaIvqgHdx 2024-09-06T14:49:47.796 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.QiaIvqgHdx is 10KB 2024-09-06T14:49:47.810 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.QiaIvqgHdx 2024-09-06T14:49:47.816 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-06T14:49:47.875 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T14:49:47.875 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-06T14:49:47.875 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-06T14:49:47.948 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-06T14:49:47.948 DEBUG:teuthology.orchestra.run.smithi189:> sudo update-grub 2024-09-06T14:49:49.020 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub' 2024-09-06T14:49:49.021 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-06T14:49:49.022 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-09-06T14:49:49.197 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:49.202 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:49.443 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:49.449 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:49.489 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-06T14:49:49.494 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-06T14:49:49.545 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-06T14:49:49.546 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub' 2024-09-06T14:49:49.576 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-06T14:49:49.600 INFO:teuthology.orchestra.run.smithi190.stdout:Generating grub configuration file ... 2024-09-06T14:49:49.604 INFO:teuthology.orchestra.run.smithi189.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-06T14:49:49.604 INFO:teuthology.orchestra.run.smithi189.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-06T14:49:49.604 INFO:teuthology.orchestra.run.smithi189.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-06T14:49:49.614 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-09-06T14:49:49.625 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-09-06T14:49:49.846 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:49.861 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:50.149 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:50.154 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-06T14:49:50.230 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-06T14:49:50.390 INFO:teuthology.orchestra.run.smithi190.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-06T14:49:50.390 INFO:teuthology.orchestra.run.smithi190.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-06T14:49:50.390 INFO:teuthology.orchestra.run.smithi190.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-06T14:49:50.441 INFO:teuthology.orchestra.run.smithi190.stdout:done 2024-09-06T14:49:50.917 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-06T14:49:50.935 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.119.119 2024-09-06T14:49:50.936 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-06T14:49:50.937 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-06T14:49:50.937 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-06T14:49:50.937 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-06T14:49:50.937 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-06T14:49:50.937 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-06T14:49:50.938 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-06T14:49:50.938 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-06T14:49:50.938 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-06T14:49:50.938 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-06T14:49:50.938 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-09-06T14:49:50.938 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-09-06T14:49:51.102 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-06T14:49:51.210 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-06T14:49:51.333 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:49:51.417 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-06T14:49:51.496 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-06T14:49:52.628 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:49:52.646 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-06T14:49:52.700 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:49:52.892 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-06T14:49:52.893 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-06T14:49:53.063 INFO:teuthology.orchestra.run.smithi190.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-06T14:49:53.063 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:49:53.063 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:49:53.063 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:49:53.063 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:49:53.064 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-06T14:49:53.064 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-06T14:49:53.064 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:49:53.103 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-06T14:49:53.106 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-09-06T14:49:53.164 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-09-06T14:49:53.164 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.119.119 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-09-06T14:49:53.165 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-09-06T14:49:53.166 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-09-06T14:49:53.166 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-09-06T14:49:53.166 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-09-06T14:49:53.210 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.GWCI7E7M6J 2024-09-06T14:49:53.211 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GWCI7E7M6J 2024-09-06T14:49:53.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.GWCI7E7M6J 2024-09-06T14:49:53.384 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.GWCI7E7M6J is 10KB 2024-09-06T14:49:53.414 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.GWCI7E7M6J 2024-09-06T14:49:53.419 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-06T14:49:53.473 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T14:49:53.473 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-06T14:49:53.473 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-06T14:49:53.541 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-06T14:49:53.541 DEBUG:teuthology.orchestra.run.smithi190:> sudo update-grub 2024-09-06T14:49:54.738 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2024-09-06T14:49:54.739 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-06T14:49:54.741 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-09-06T14:49:54.922 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-06T14:49:54.929 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-06T14:49:55.170 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-06T14:49:55.175 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-06T14:49:55.215 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-06T14:49:55.220 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-06T14:49:55.338 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-06T14:49:55.338 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-06T14:49:55.338 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-06T14:49:55.353 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-09-06T14:49:55.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-09-06T14:50:19.693 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-06T14:50:19.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:50:19.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:50:25.369 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-06T14:50:25.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:50:25.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:50:54.397 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-06T14:51:00.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-09-06T14:51:03.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:51:03.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:51:09.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:51:09.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:51:21.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-06T14:51:27.425 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-09-06T14:51:33.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:51:33.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:51:34.612 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-06T14:51:39.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:51:39.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:51:40.018 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-06T14:51:40.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:51:40.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-06T14:51:40.850 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-09-06T14:51:40.895 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-119-generic 2024-09-06T14:51:40.896 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-06T14:51:40.896 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-06T14:51:40.896 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-06T14:51:41.897 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-06T14:51:41.897 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-06T14:51:42.366 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-09-06T14:51:42.390 DEBUG:teuthology.parallel:result is None 2024-09-06T14:51:49.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:51:49.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:51:49.917 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-06T14:51:50.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:51:50.403 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-06T14:51:50.403 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-06T14:51:50.451 INFO:teuthology.orchestra.run.smithi189.stdout:5.15.0-119-generic 2024-09-06T14:51:50.451 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-06T14:51:50.451 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-06T14:51:50.451 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-06T14:51:51.453 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-06T14:51:51.453 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-06T14:51:51.527 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-09-06T14:51:51.573 DEBUG:teuthology.parallel:result is None 2024-09-06T14:51:51.574 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-06T14:51:51.585 INFO:teuthology.task.internal:Creating test directory... 2024-09-06T14:51:51.586 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-06T14:51:51.588 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-06T14:51:51.595 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-06T14:51:51.605 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-06T14:51:51.615 INFO:teuthology.task.internal:Creating archive directory... 2024-09-06T14:51:51.616 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-06T14:51:51.636 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-06T14:51:51.809 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-06T14:51:51.815 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-06T14:51:51.815 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-06T14:51:51.818 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-06T14:51:51.840 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:51:51.840 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:51:51.847 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:51:51.848 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:51:51.850 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-06T14:51:51.857 INFO:teuthology.task.internal:Configuring sudo... 2024-09-06T14:51:51.857 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-06T14:51:51.892 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-06T14:51:51.927 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-06T14:51:51.937 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-06T14:51:51.937 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-06T14:51:51.948 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-06T14:51:51.976 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:51:51.999 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:51:52.048 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T14:51:52.048 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-06T14:51:52.114 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:51:52.120 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:51:52.168 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T14:51:52.168 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-06T14:51:52.241 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-06T14:51:52.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-09-06T14:51:52.330 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-06T14:51:52.338 INFO:teuthology.task.internal:Starting timer... 2024-09-06T14:51:52.338 INFO:teuthology.run_tasks:Running task pcp... 2024-09-06T14:51:52.358 INFO:teuthology.run_tasks:Running task selinux... 2024-09-06T14:51:52.366 DEBUG:teuthology.task.selinux:Excluding smithi189: OS 'ubuntu' does not support SELinux 2024-09-06T14:51:52.366 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2024-09-06T14:51:52.366 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-06T14:51:52.366 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-06T14:51:52.367 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-06T14:51:52.367 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-06T14:51:52.375 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-06T14:51:52.387 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-06T14:51:52.415 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi189.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-06T14:59:17.819 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi189.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-09-06T14:59:17.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:59:17.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:59:17.911 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-06T14:59:17.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-06T14:59:17.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:59:17.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:59:18.080 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-09-06T14:59:18.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-09-06T14:59:18.157 INFO:teuthology.run_tasks:Running task clock... 2024-09-06T14:59:18.167 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-06T14:59:18.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-06T14:59:18.168 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T14:59:18.170 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-06T14:59:18.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Command line: ntpd -gq 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: ---------------------------------------------------- 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: ntp-4 is maintained by Network Time Foundation, 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: corporation. Support and training for ntp-4 are 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: available at https://www.nwtime.org/support 2024-09-06T14:59:18.197 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: ---------------------------------------------------- 2024-09-06T14:59:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: proto: precision = 0.062 usec (-24) 2024-09-06T14:59:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: basedate set to 2022-02-04 2024-09-06T14:59:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: gps base set to 2022-02-06 (week 2196) 2024-09-06T14:59:18.198 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-06T14:59:18.199 INFO:teuthology.orchestra.run.smithi189.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-06T14:59:18.199 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: restrict ::: KOD does nothing without LIMITED. 2024-09-06T14:59:18.200 INFO:teuthology.orchestra.run.smithi189.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen and drop on 0 v6wildcard [::]:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen normally on 2 lo 127.0.0.1:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen normally on 3 enp3s0f1 172.21.15.189:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen normally on 4 lo [::1]:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df1%5]:123 2024-09-06T14:59:18.201 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:18 ntpd[18427]: Listening on routing socket on fd #22 for interface updates 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Command line: ntpd -gq 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: ---------------------------------------------------- 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: ntp-4 is maintained by Network Time Foundation, 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: corporation. Support and training for ntp-4 are 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: available at https://www.nwtime.org/support 2024-09-06T14:59:18.227 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: ---------------------------------------------------- 2024-09-06T14:59:18.228 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: proto: precision = 0.060 usec (-24) 2024-09-06T14:59:18.228 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: basedate set to 2022-02-04 2024-09-06T14:59:18.228 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: gps base set to 2022-02-06 (week 2196) 2024-09-06T14:59:18.228 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-06T14:59:18.229 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-06T14:59:18.229 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: restrict ::: KOD does nothing without LIMITED. 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen and drop on 0 v6wildcard [::]:123 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen normally on 2 lo 127.0.0.1:123 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2024-09-06T14:59:18.230 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen normally on 4 lo [::1]:123 2024-09-06T14:59:18.231 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2024-09-06T14:59:18.231 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:18 ntpd[18456]: Listening on routing socket on fd #22 for interface updates 2024-09-06T14:59:19.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:19.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:19.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:19.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:19 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:21.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:21.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:21 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:21.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:21 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:23 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:23.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:23.230 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:23 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:25.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.198 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stdout: 6 Sep 14:59:25 ntpd[18427]: ntpd: time slew -0.000429 s 2024-09-06T14:59:25.199 INFO:teuthology.orchestra.run.smithi189.stdout:ntpd: time slew -0.000429s 2024-09-06T14:59:25.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-06T14:59:25.200 INFO:teuthology.orchestra.run.smithi189.stderr: 6 Sep 14:59:25 ntpd[18427]: can't open /var/log/ntpstats/loopstats.20240906: Permission denied 2024-09-06T14:59:25.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:25.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:25.230 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:25.230 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:25 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:25.245 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/rawstats.20240906: Permission denied 2024-09-06T14:59:27.228 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-06T14:59:27.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/peerstats.20240906: Permission denied 2024-09-06T14:59:27.229 INFO:teuthology.orchestra.run.smithi190.stdout: 6 Sep 14:59:27 ntpd[18456]: ntpd: time slew -0.001660 s 2024-09-06T14:59:27.229 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.001660s 2024-09-06T14:59:27.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-06T14:59:27.229 INFO:teuthology.orchestra.run.smithi190.stderr: 6 Sep 14:59:27 ntpd[18456]: can't open /var/log/ntpstats/loopstats.20240906: Permission denied 2024-09-06T14:59:27.286 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-06T14:59:27.286 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-06T14:59:27.286 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:27.286 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:27.286 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:27.287 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-06T14:59:27.287 INFO:teuthology.run_tasks:Running task install... 2024-09-06T14:59:27.296 DEBUG:teuthology.task.install:project ceph 2024-09-06T14:59:27.296 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}} 2024-09-06T14:59:27.296 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'} 2024-09-06T14:59:27.296 INFO:teuthology.task.install:Using flavor: default 2024-09-06T14:59:27.313 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-06T14:59:27.313 INFO:teuthology.task.install:extra packages: [] 2024-09-06T14:59:27.314 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-key list | grep Ceph 2024-09-06T14:59:27.314 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2024-09-06T14:59:27.375 INFO:teuthology.orchestra.run.smithi189.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-06T14:59:27.383 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-06T14:59:27.403 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-06T14:59:27.403 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph.com (release key) 2024-09-06T14:59:27.404 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-06T14:59:27.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:59:27.417 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-06T14:59:27.417 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2024-09-06T14:59:27.417 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-06T14:59:27.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:59:27.559 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/ 2024-09-06T14:59:27.559 INFO:teuthology.task.install.deb:Package version is 19.3.0-4704-g8b38c33c-1jammy 2024-09-06T14:59:27.575 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/ 2024-09-06T14:59:27.575 INFO:teuthology.task.install.deb:Package version is 19.3.0-4704-g8b38c33c-1jammy 2024-09-06T14:59:27.681 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T14:59:27.681 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-06T14:59:27.696 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T14:59:27.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-06T14:59:27.698 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-06T14:59:27.711 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-09-06T14:59:27.885 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-06T14:59:27.920 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy InRelease 2024-09-06T14:59:27.933 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy InRelease 2024-09-06T14:59:27.941 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-06T14:59:27.955 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-06T14:59:27.963 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-06T14:59:27.977 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-06T14:59:27.984 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-06T14:59:27.991 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:59:28.010 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-06T14:59:28.010 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-06T14:59:28.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-06T14:59:28.012 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-06T14:59:28.039 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-06T14:59:28.073 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-06T14:59:28.080 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-06T14:59:28.150 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-06T14:59:28.161 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-06T14:59:28.298 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 29.3 kB in 0s (70.7 kB/s) 2024-09-06T14:59:28.383 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 29.3 kB in 0s (59.9 kB/s) 2024-09-06T14:59:29.360 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:59:29.378 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4704-g8b38c33c-1jammy cephadm=19.3.0-4704-g8b38c33c-1jammy ceph-mds=19.3.0-4704-g8b38c33c-1jammy ceph-mgr=19.3.0-4704-g8b38c33c-1jammy ceph-common=19.3.0-4704-g8b38c33c-1jammy ceph-fuse=19.3.0-4704-g8b38c33c-1jammy ceph-test=19.3.0-4704-g8b38c33c-1jammy ceph-volume=19.3.0-4704-g8b38c33c-1jammy radosgw=19.3.0-4704-g8b38c33c-1jammy python3-rados=19.3.0-4704-g8b38c33c-1jammy python3-rgw=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy python3-rbd=19.3.0-4704-g8b38c33c-1jammy libcephfs2=19.3.0-4704-g8b38c33c-1jammy libcephfs-dev=19.3.0-4704-g8b38c33c-1jammy librados2=19.3.0-4704-g8b38c33c-1jammy librbd1=19.3.0-4704-g8b38c33c-1jammy rbd-fuse=19.3.0-4704-g8b38c33c-1jammy 2024-09-06T14:59:29.441 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-06T14:59:29.451 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:59:29.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4704-g8b38c33c-1jammy cephadm=19.3.0-4704-g8b38c33c-1jammy ceph-mds=19.3.0-4704-g8b38c33c-1jammy ceph-mgr=19.3.0-4704-g8b38c33c-1jammy ceph-common=19.3.0-4704-g8b38c33c-1jammy ceph-fuse=19.3.0-4704-g8b38c33c-1jammy ceph-test=19.3.0-4704-g8b38c33c-1jammy ceph-volume=19.3.0-4704-g8b38c33c-1jammy radosgw=19.3.0-4704-g8b38c33c-1jammy python3-rados=19.3.0-4704-g8b38c33c-1jammy python3-rgw=19.3.0-4704-g8b38c33c-1jammy python3-cephfs=19.3.0-4704-g8b38c33c-1jammy python3-rbd=19.3.0-4704-g8b38c33c-1jammy libcephfs2=19.3.0-4704-g8b38c33c-1jammy libcephfs-dev=19.3.0-4704-g8b38c33c-1jammy librados2=19.3.0-4704-g8b38c33c-1jammy librbd1=19.3.0-4704-g8b38c33c-1jammy rbd-fuse=19.3.0-4704-g8b38c33c-1jammy 2024-09-06T14:59:29.531 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-09-06T14:59:29.648 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-06T14:59:29.649 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-06T14:59:29.738 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-09-06T14:59:29.739 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-06T14:59:29.847 INFO:teuthology.orchestra.run.smithi189.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-06T14:59:29.848 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:59:29.848 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-09-06T14:59:29.848 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-06T14:59:29.848 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-06T14:59:29.849 INFO:teuthology.orchestra.run.smithi189.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-06T14:59:29.849 INFO:teuthology.orchestra.run.smithi189.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-06T14:59:29.850 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet zip 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-06T14:59:29.851 INFO:teuthology.orchestra.run.smithi189.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-06T14:59:29.852 INFO:teuthology.orchestra.run.smithi189.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-06T14:59:29.852 INFO:teuthology.orchestra.run.smithi189.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-06T14:59:29.852 INFO:teuthology.orchestra.run.smithi189.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-06T14:59:29.852 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-09-06T14:59:29.852 INFO:teuthology.orchestra.run.smithi189.stdout: btrfs-tools 2024-09-06T14:59:29.949 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-09-06T14:59:29.949 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-06T14:59:29.949 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-06T14:59:29.949 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-06T14:59:29.950 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-06T14:59:29.952 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-06T14:59:29.953 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet zip 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-09-06T14:59:29.954 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-06T14:59:29.955 INFO:teuthology.orchestra.run.smithi189.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-06T14:59:29.956 INFO:teuthology.orchestra.run.smithi189.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-06T14:59:29.957 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-06T14:59:29.958 INFO:teuthology.orchestra.run.smithi189.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-06T14:59:30.057 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-06T14:59:30.058 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-06T14:59:30.059 INFO:teuthology.orchestra.run.smithi190.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-06T14:59:30.099 INFO:teuthology.orchestra.run.smithi189.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-06T14:59:30.099 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 251 MB of archives. 2024-09-06T14:59:30.100 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-06T14:59:30.100 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4704-g8b38c33c-1jammy [3,630 kB] 2024-09-06T14:59:30.143 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-06T14:59:30.202 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-06T14:59:30.202 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 251 MB of archives. 2024-09-06T14:59:30.202 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-06T14:59:30.202 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4704-g8b38c33c-1jammy [3,630 kB] 2024-09-06T14:59:30.246 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-06T14:59:30.281 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4704-g8b38c33c-1jammy [3,321 kB] 2024-09-06T14:59:30.341 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4704-g8b38c33c-1jammy [722 kB] 2024-09-06T14:59:30.360 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4704-g8b38c33c-1jammy [356 kB] 2024-09-06T14:59:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4704-g8b38c33c-1jammy [32.8 kB] 2024-09-06T14:59:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4704-g8b38c33c-1jammy [180 kB] 2024-09-06T14:59:30.371 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4704-g8b38c33c-1jammy [71.7 kB] 2024-09-06T14:59:30.372 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4704-g8b38c33c-1jammy [338 kB] 2024-09-06T14:59:30.382 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4704-g8b38c33c-1jammy [7,979 kB] 2024-09-06T14:59:30.502 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4704-g8b38c33c-1jammy [3,321 kB] 2024-09-06T14:59:30.556 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4704-g8b38c33c-1jammy [112 kB] 2024-09-06T14:59:30.564 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4704-g8b38c33c-1jammy [473 kB] 2024-09-06T14:59:30.565 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-06T14:59:30.578 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-06T14:59:30.581 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4704-g8b38c33c-1jammy [28.2 MB] 2024-09-06T14:59:30.659 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-06T14:59:30.670 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-06T14:59:30.672 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4704-g8b38c33c-1jammy [722 kB] 2024-09-06T14:59:30.683 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-06T14:59:30.687 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4704-g8b38c33c-1jammy [356 kB] 2024-09-06T14:59:30.731 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4704-g8b38c33c-1jammy [32.8 kB] 2024-09-06T14:59:30.732 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4704-g8b38c33c-1jammy [180 kB] 2024-09-06T14:59:30.736 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4704-g8b38c33c-1jammy [71.7 kB] 2024-09-06T14:59:30.738 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4704-g8b38c33c-1jammy [338 kB] 2024-09-06T14:59:30.745 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4704-g8b38c33c-1jammy [7,979 kB] 2024-09-06T14:59:30.764 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-06T14:59:30.887 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-06T14:59:30.898 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-06T14:59:30.928 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-06T14:59:30.936 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-06T14:59:30.937 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-06T14:59:30.938 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-06T14:59:30.956 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-06T14:59:30.961 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-06T14:59:30.965 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-06T14:59:30.969 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-06T14:59:31.005 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-06T14:59:31.020 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-06T14:59:31.050 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-06T14:59:31.054 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-06T14:59:31.055 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-06T14:59:31.059 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-06T14:59:31.063 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-06T14:59:31.063 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-06T14:59:31.064 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-06T14:59:31.064 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-06T14:59:31.065 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-06T14:59:31.065 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-06T14:59:31.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-06T14:59:31.067 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-06T14:59:31.068 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-06T14:59:31.082 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-06T14:59:31.086 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-06T14:59:31.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-06T14:59:31.094 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-06T14:59:31.132 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-06T14:59:31.150 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-06T14:59:31.151 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-06T14:59:31.151 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-06T14:59:31.157 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-06T14:59:31.158 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-06T14:59:31.165 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4704-g8b38c33c-1jammy [112 kB] 2024-09-06T14:59:31.168 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4704-g8b38c33c-1jammy [473 kB] 2024-09-06T14:59:31.169 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-06T14:59:31.173 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-06T14:59:31.178 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4704-g8b38c33c-1jammy [28.2 MB] 2024-09-06T14:59:31.178 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-06T14:59:31.181 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-06T14:59:31.182 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-06T14:59:31.212 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-06T14:59:31.214 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-06T14:59:31.214 INFO:teuthology.orchestra.run.smithi189.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-06T14:59:31.217 INFO:teuthology.orchestra.run.smithi189.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-06T14:59:31.217 INFO:teuthology.orchestra.run.smithi189.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-06T14:59:31.250 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-06T14:59:31.251 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-06T14:59:31.252 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-06T14:59:31.253 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-06T14:59:31.294 INFO:teuthology.orchestra.run.smithi189.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-06T14:59:31.332 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-06T14:59:31.332 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-06T14:59:31.334 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-06T14:59:31.339 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-06T14:59:31.341 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-06T14:59:31.342 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-06T14:59:31.343 INFO:teuthology.orchestra.run.smithi189.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-06T14:59:31.345 INFO:teuthology.orchestra.run.smithi189.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-06T14:59:31.399 INFO:teuthology.orchestra.run.smithi189.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-06T14:59:31.400 INFO:teuthology.orchestra.run.smithi189.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4704-g8b38c33c-1jammy [5,203 kB] 2024-09-06T14:59:31.410 INFO:teuthology.orchestra.run.smithi189.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-06T14:59:31.411 INFO:teuthology.orchestra.run.smithi189.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-06T14:59:31.412 INFO:teuthology.orchestra.run.smithi189.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-06T14:59:31.413 INFO:teuthology.orchestra.run.smithi189.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-06T14:59:31.413 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-06T14:59:31.415 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-06T14:59:31.416 INFO:teuthology.orchestra.run.smithi189.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-06T14:59:31.416 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-06T14:59:31.417 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-06T14:59:31.419 INFO:teuthology.orchestra.run.smithi189.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-06T14:59:31.457 INFO:teuthology.orchestra.run.smithi189.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-06T14:59:31.480 INFO:teuthology.orchestra.run.smithi189.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4704-g8b38c33c-1jammy [252 kB] 2024-09-06T14:59:31.482 INFO:teuthology.orchestra.run.smithi189.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4704-g8b38c33c-1jammy [124 kB] 2024-09-06T14:59:31.483 INFO:teuthology.orchestra.run.smithi189.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4704-g8b38c33c-1jammy [1,561 kB] 2024-09-06T14:59:31.495 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-06T14:59:31.497 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-06T14:59:31.498 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-06T14:59:31.502 INFO:teuthology.orchestra.run.smithi189.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-06T14:59:31.504 INFO:teuthology.orchestra.run.smithi189.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-06T14:59:31.508 INFO:teuthology.orchestra.run.smithi189.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-06T14:59:31.509 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-06T14:59:31.510 INFO:teuthology.orchestra.run.smithi189.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-06T14:59:31.510 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-06T14:59:31.511 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-06T14:59:31.511 INFO:teuthology.orchestra.run.smithi189.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-06T14:59:31.522 INFO:teuthology.orchestra.run.smithi189.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4704-g8b38c33c-1jammy [6,310 kB] 2024-09-06T14:59:31.541 INFO:teuthology.orchestra.run.smithi189.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-06T14:59:31.576 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-06T14:59:31.579 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-06T14:59:31.583 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-06T14:59:31.585 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-06T14:59:31.658 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-06T14:59:31.660 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-06T14:59:31.665 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-06T14:59:31.666 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-06T14:59:31.668 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-06T14:59:31.669 INFO:teuthology.orchestra.run.smithi189.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4704-g8b38c33c-1jammy [23.1 MB] 2024-09-06T14:59:31.673 INFO:teuthology.orchestra.run.smithi189.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-06T14:59:31.674 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-06T14:59:31.675 INFO:teuthology.orchestra.run.smithi189.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-06T14:59:31.678 INFO:teuthology.orchestra.run.smithi189.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-06T14:59:31.678 INFO:teuthology.orchestra.run.smithi189.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-06T14:59:31.681 INFO:teuthology.orchestra.run.smithi189.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-06T14:59:31.737 INFO:teuthology.orchestra.run.smithi189.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-06T14:59:31.749 INFO:teuthology.orchestra.run.smithi189.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-06T14:59:31.749 INFO:teuthology.orchestra.run.smithi189.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-06T14:59:31.801 INFO:teuthology.orchestra.run.smithi189.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-06T14:59:31.801 INFO:teuthology.orchestra.run.smithi189.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-06T14:59:31.802 INFO:teuthology.orchestra.run.smithi189.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-06T14:59:31.803 INFO:teuthology.orchestra.run.smithi189.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-06T14:59:31.804 INFO:teuthology.orchestra.run.smithi189.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-06T14:59:31.805 INFO:teuthology.orchestra.run.smithi189.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-06T14:59:31.837 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-06T14:59:31.839 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-06T14:59:31.842 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-06T14:59:31.843 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-06T14:59:31.846 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-06T14:59:31.865 INFO:teuthology.orchestra.run.smithi189.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-06T14:59:31.866 INFO:teuthology.orchestra.run.smithi189.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-06T14:59:31.873 INFO:teuthology.orchestra.run.smithi189.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-06T14:59:31.906 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-06T14:59:31.909 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-06T14:59:31.910 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-06T14:59:31.943 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-06T14:59:31.944 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-06T14:59:31.947 INFO:teuthology.orchestra.run.smithi189.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-06T14:59:31.952 INFO:teuthology.orchestra.run.smithi189.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-06T14:59:31.952 INFO:teuthology.orchestra.run.smithi189.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-06T14:59:31.960 INFO:teuthology.orchestra.run.smithi189.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-06T14:59:31.966 INFO:teuthology.orchestra.run.smithi189.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-06T14:59:31.968 INFO:teuthology.orchestra.run.smithi189.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-06T14:59:31.969 INFO:teuthology.orchestra.run.smithi189.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-06T14:59:32.006 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-06T14:59:32.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-06T14:59:32.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-06T14:59:32.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-06T14:59:32.012 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-06T14:59:32.013 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-06T14:59:32.021 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-06T14:59:32.028 INFO:teuthology.orchestra.run.smithi189.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-06T14:59:32.030 INFO:teuthology.orchestra.run.smithi189.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-06T14:59:32.038 INFO:teuthology.orchestra.run.smithi189.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-06T14:59:32.087 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-06T14:59:32.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-06T14:59:32.093 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-06T14:59:32.109 INFO:teuthology.orchestra.run.smithi189.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-06T14:59:32.112 INFO:teuthology.orchestra.run.smithi189.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-06T14:59:32.112 INFO:teuthology.orchestra.run.smithi189.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-06T14:59:32.116 INFO:teuthology.orchestra.run.smithi189.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-06T14:59:32.118 INFO:teuthology.orchestra.run.smithi189.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-06T14:59:32.136 INFO:teuthology.orchestra.run.smithi189.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-06T14:59:32.137 INFO:teuthology.orchestra.run.smithi189.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-06T14:59:32.168 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-06T14:59:32.175 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-06T14:59:32.178 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-06T14:59:32.180 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-06T14:59:32.191 INFO:teuthology.orchestra.run.smithi189.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-06T14:59:32.191 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-06T14:59:32.193 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-06T14:59:32.196 INFO:teuthology.orchestra.run.smithi189.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-06T14:59:32.198 INFO:teuthology.orchestra.run.smithi189.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-06T14:59:32.200 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-06T14:59:32.250 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-06T14:59:32.252 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-06T14:59:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-06T14:59:32.310 INFO:teuthology.orchestra.run.smithi189.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4704-g8b38c33c-1jammy [14.1 kB] 2024-09-06T14:59:32.311 INFO:teuthology.orchestra.run.smithi189.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [880 kB] 2024-09-06T14:59:32.326 INFO:teuthology.orchestra.run.smithi189.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4704-g8b38c33c-1jammy [2,437 kB] 2024-09-06T14:59:32.332 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-06T14:59:32.334 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-06T14:59:32.354 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-06T14:59:32.355 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-06T14:59:32.356 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-06T14:59:32.364 INFO:teuthology.orchestra.run.smithi189.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4704-g8b38c33c-1jammy [812 kB] 2024-09-06T14:59:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-06T14:59:32.365 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-06T14:59:32.372 INFO:teuthology.orchestra.run.smithi189.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4704-g8b38c33c-1jammy [160 kB] 2024-09-06T14:59:32.374 INFO:teuthology.orchestra.run.smithi189.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4704-g8b38c33c-1jammy [61.4 MB] 2024-09-06T14:59:32.528 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4704-g8b38c33c-1jammy [5,203 kB] 2024-09-06T14:59:32.678 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4704-g8b38c33c-1jammy [252 kB] 2024-09-06T14:59:32.683 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4704-g8b38c33c-1jammy [124 kB] 2024-09-06T14:59:32.685 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4704-g8b38c33c-1jammy [1,561 kB] 2024-09-06T14:59:32.759 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4704-g8b38c33c-1jammy [6,310 kB] 2024-09-06T14:59:33.088 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4704-g8b38c33c-1jammy [23.1 MB] 2024-09-06T14:59:34.111 INFO:teuthology.orchestra.run.smithi189.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4704-g8b38c33c-1jammy [8,625 kB] 2024-09-06T14:59:34.147 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4704-g8b38c33c-1jammy [14.1 kB] 2024-09-06T14:59:34.148 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [880 kB] 2024-09-06T14:59:34.164 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4704-g8b38c33c-1jammy [2,437 kB] 2024-09-06T14:59:34.204 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4704-g8b38c33c-1jammy [812 kB] 2024-09-06T14:59:34.213 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4704-g8b38c33c-1jammy [160 kB] 2024-09-06T14:59:34.215 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4704-g8b38c33c-1jammy [61.4 MB] 2024-09-06T14:59:34.242 INFO:teuthology.orchestra.run.smithi189.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4704-g8b38c33c-1jammy [14.2 kB] 2024-09-06T14:59:34.267 INFO:teuthology.orchestra.run.smithi189.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4704-g8b38c33c-1jammy [55.7 MB] 2024-09-06T14:59:35.984 INFO:teuthology.orchestra.run.smithi189.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4704-g8b38c33c-1jammy [130 kB] 2024-09-06T14:59:35.987 INFO:teuthology.orchestra.run.smithi189.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4704-g8b38c33c-1jammy [39.0 kB] 2024-09-06T14:59:35.988 INFO:teuthology.orchestra.run.smithi189.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4704-g8b38c33c-1jammy [15.9 MB] 2024-09-06T14:59:36.491 INFO:teuthology.orchestra.run.smithi189.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [91.3 kB] 2024-09-06T14:59:36.754 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4704-g8b38c33c-1jammy [8,625 kB] 2024-09-06T14:59:36.864 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4704-g8b38c33c-1jammy [14.2 kB] 2024-09-06T14:59:36.864 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4704-g8b38c33c-1jammy [55.7 MB] 2024-09-06T14:59:37.063 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 251 MB in 7s (38.4 MB/s) 2024-09-06T14:59:37.222 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-06T14:59:37.322 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-06T14:59:37.327 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-06T14:59:37.413 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-06T14:59:37.758 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-06T14:59:37.784 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-06T14:59:37.824 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-06T14:59:38.036 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4704-g8b38c33c-1jammy [130 kB] 2024-09-06T14:59:38.038 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4704-g8b38c33c-1jammy [39.0 kB] 2024-09-06T14:59:38.039 INFO:teuthology.orchestra.run.smithi190.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4704-g8b38c33c-1jammy [15.9 MB] 2024-09-06T14:59:38.102 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-06T14:59:38.129 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-06T14:59:38.241 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-06T14:59:38.349 INFO:teuthology.orchestra.run.smithi190.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4704-g8b38c33c-1jammy [91.3 kB] 2024-09-06T14:59:38.598 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-06T14:59:38.624 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:38.672 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:38.927 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 251 MB in 8s (30.3 MB/s) 2024-09-06T14:59:39.084 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-06T14:59:39.092 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-06T14:59:39.110 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:39.159 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:39.193 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-06T14:59:39.198 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-06T14:59:39.282 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-06T14:59:39.487 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-06T14:59:39.513 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:39.554 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:39.594 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-06T14:59:39.620 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-06T14:59:39.652 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-06T14:59:39.874 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-06T14:59:39.900 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-06T14:59:39.940 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-06T14:59:40.021 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-06T14:59:40.048 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-06T14:59:40.088 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-06T14:59:40.268 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librados2. 2024-09-06T14:59:40.294 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../007-librados2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:40.335 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:40.558 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-06T14:59:40.585 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:40.633 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:40.813 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librbd1. 2024-09-06T14:59:40.839 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../008-librbd1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:40.879 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:40.986 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-06T14:59:41.013 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:41.044 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:41.549 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs2. 2024-09-06T14:59:41.575 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:41.605 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-06T14:59:41.615 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:41.632 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-06T14:59:41.672 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T14:59:41.868 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rados. 2024-09-06T14:59:41.894 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:41.926 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:42.009 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-06T14:59:42.035 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-06T14:59:42.075 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-06T14:59:42.246 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-06T14:59:42.272 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T14:59:42.312 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:42.378 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2024-09-06T14:59:42.489 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-librados2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:42.489 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:42.564 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cephfs. 2024-09-06T14:59:42.580 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:42.623 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:42.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2024-09-06T14:59:42.890 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-librbd1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:42.918 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-06T14:59:42.930 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:42.944 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T14:59:42.984 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:43.279 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-06T14:59:43.305 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-06T14:59:43.337 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-06T14:59:43.383 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2024-09-06T14:59:43.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:43.449 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:43.648 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-prettytable. 2024-09-06T14:59:43.674 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-06T14:59:43.715 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-06T14:59:43.718 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2024-09-06T14:59:43.734 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:43.777 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:43.984 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rbd. 2024-09-06T14:59:44.010 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:44.051 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:44.079 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-06T14:59:44.106 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T14:59:44.146 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:44.357 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2024-09-06T14:59:44.372 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:44.387 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-06T14:59:44.413 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-06T14:59:44.415 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:44.454 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-06T14:59:44.698 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-06T14:59:44.724 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-06T14:59:44.726 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-06T14:59:44.752 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T14:59:44.756 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-06T14:59:44.792 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:45.051 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-06T14:59:45.077 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-06T14:59:45.112 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-06T14:59:45.117 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-06T14:59:45.138 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-06T14:59:45.178 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-06T14:59:45.446 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua5.1. 2024-09-06T14:59:45.472 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-06T14:59:45.506 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2024-09-06T14:59:45.512 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-06T14:59:45.533 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-06T14:59:45.581 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-06T14:59:45.807 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-any. 2024-09-06T14:59:45.822 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-06T14:59:45.825 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2024-09-06T14:59:45.841 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:45.857 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-06T14:59:45.875 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:46.093 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package zip. 2024-09-06T14:59:46.108 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-06T14:59:46.151 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking zip (3.0-12build2) ... 2024-09-06T14:59:46.211 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-06T14:59:46.238 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-06T14:59:46.278 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-06T14:59:46.488 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package unzip. 2024-09-06T14:59:46.514 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-06T14:59:46.554 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-06T14:59:46.934 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package luarocks. 2024-09-06T14:59:46.960 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-06T14:59:46.963 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-06T14:59:46.979 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-06T14:59:46.992 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-06T14:59:47.022 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-06T14:59:47.333 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-06T14:59:47.349 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librgw2. 2024-09-06T14:59:47.360 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-06T14:59:47.376 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../025-librgw2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:47.400 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-06T14:59:47.416 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:47.711 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua5.1. 2024-09-06T14:59:47.727 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-06T14:59:47.761 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-06T14:59:48.035 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rgw. 2024-09-06T14:59:48.050 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:48.072 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-any. 2024-09-06T14:59:48.087 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-06T14:59:48.093 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:48.130 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-06T14:59:48.383 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package zip. 2024-09-06T14:59:48.398 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-06T14:59:48.441 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking zip (3.0-12build2) ... 2024-09-06T14:59:48.446 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-06T14:59:48.473 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-06T14:59:48.513 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-06T14:59:48.774 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libradosstriper1. 2024-09-06T14:59:48.778 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package unzip. 2024-09-06T14:59:48.801 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:48.805 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-06T14:59:48.841 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:48.844 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-06T14:59:49.198 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package luarocks. 2024-09-06T14:59:49.224 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-06T14:59:49.256 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-06T14:59:49.269 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-common. 2024-09-06T14:59:49.296 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:49.336 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:49.639 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2024-09-06T14:59:49.666 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-librgw2_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:49.713 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:50.325 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2024-09-06T14:59:50.351 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:50.383 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:50.685 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-06T14:59:50.712 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-06T14:59:50.752 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-06T14:59:50.842 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-base. 2024-09-06T14:59:50.868 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:50.917 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:51.071 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2024-09-06T14:59:51.098 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:51.138 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:51.479 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-06T14:59:51.505 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-06T14:59:51.525 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2024-09-06T14:59:51.537 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-06T14:59:51.551 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:51.582 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:52.065 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cheroot. 2024-09-06T14:59:52.091 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-06T14:59:52.148 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-06T14:59:52.460 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-06T14:59:52.486 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-06T14:59:52.526 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-06T14:59:52.796 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-06T14:59:52.822 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-06T14:59:52.854 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-06T14:59:53.132 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-06T14:59:53.158 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-06T14:59:53.163 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2024-09-06T14:59:53.190 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T14:59:53.198 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-06T14:59:53.239 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T14:59:53.510 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-tempora. 2024-09-06T14:59:53.536 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-06T14:59:53.576 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-06T14:59:53.792 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-06T14:59:53.819 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-06T14:59:53.858 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-06T14:59:53.879 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-portend. 2024-09-06T14:59:53.905 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-06T14:59:53.946 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-06T14:59:54.145 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2024-09-06T14:59:54.171 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-06T14:59:54.199 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-06T14:59:54.211 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-06T14:59:54.225 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-06T14:59:54.265 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-06T14:59:54.514 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-06T14:59:54.541 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-06T14:59:54.568 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-06T14:59:54.580 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-06T14:59:54.594 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-06T14:59:54.635 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-06T14:59:54.868 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-06T14:59:54.895 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-06T14:59:54.935 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-06T14:59:54.947 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-natsort. 2024-09-06T14:59:54.973 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-06T14:59:55.005 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-06T14:59:55.238 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-06T14:59:55.264 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-06T14:59:55.308 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-logutils. 2024-09-06T14:59:55.329 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-06T14:59:55.334 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-06T14:59:55.383 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-06T14:59:55.598 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2024-09-06T14:59:55.625 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-06T14:59:55.657 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-06T14:59:55.669 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-06T14:59:55.696 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-06T14:59:55.727 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-06T14:59:55.935 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2024-09-06T14:59:55.961 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-06T14:59:56.001 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-06T14:59:56.022 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-mako. 2024-09-06T14:59:56.048 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-06T14:59:56.089 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-06T14:59:56.304 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-06T14:59:56.331 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-06T14:59:56.379 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-06T14:59:56.417 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-06T14:59:56.444 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-06T14:59:56.484 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-06T14:59:56.682 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-06T14:59:56.708 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-06T14:59:56.748 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-06T14:59:56.813 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-06T14:59:56.853 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-06T14:59:57.123 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webob. 2024-09-06T14:59:57.149 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-06T14:59:57.181 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-06T14:59:57.290 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2024-09-06T14:59:57.316 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-06T14:59:57.393 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-06T14:59:57.500 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-waitress. 2024-09-06T14:59:57.527 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-06T14:59:57.571 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-06T14:59:57.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2024-09-06T14:59:57.756 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-06T14:59:57.796 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-06T14:59:57.870 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-tempita. 2024-09-06T14:59:57.897 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-06T14:59:57.937 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-06T14:59:58.074 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-06T14:59:58.101 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-06T14:59:58.240 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-paste. 2024-09-06T14:59:58.266 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-06T14:59:58.306 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-06T14:59:58.452 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2024-09-06T14:59:58.478 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-06T14:59:58.518 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-06T14:59:58.651 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-06T14:59:58.678 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-06T14:59:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-06T14:59:58.855 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-06T14:59:58.882 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-06T14:59:58.921 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-06T14:59:58.970 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-06T14:59:58.997 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-06T14:59:59.029 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-06T14:59:59.224 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-06T14:59:59.250 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-06T14:59:59.290 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-06T14:59:59.332 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webtest. 2024-09-06T14:59:59.358 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-06T14:59:59.398 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-06T14:59:59.577 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2024-09-06T14:59:59.605 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-06T14:59:59.663 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-06T14:59:59.743 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pecan. 2024-09-06T14:59:59.769 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-06T14:59:59.810 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-06T14:59:59.979 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2024-09-06T15:00:00.006 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-06T15:00:00.041 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-06T15:00:00.164 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-certifi. 2024-09-06T15:00:00.191 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-06T15:00:00.231 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-06T15:00:00.324 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2024-09-06T15:00:00.351 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-06T15:00:00.390 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-06T15:00:00.542 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-idna. 2024-09-06T15:00:00.568 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-06T15:00:00.617 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-06T15:00:00.685 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2024-09-06T15:00:00.712 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-06T15:00:00.751 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-06T15:00:00.929 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-urllib3. 2024-09-06T15:00:00.955 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-06T15:00:00.995 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-06T15:00:01.046 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-06T15:00:01.061 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-06T15:00:01.104 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-06T15:00:01.390 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-06T15:00:01.417 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-06T15:00:01.457 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-06T15:00:01.768 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2024-09-06T15:00:01.795 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-06T15:00:01.835 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-06T15:00:02.141 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-requests. 2024-09-06T15:00:02.146 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2024-09-06T15:00:02.167 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-06T15:00:02.173 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-06T15:00:02.207 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-06T15:00:02.212 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-06T15:00:02.575 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2024-09-06T15:00:02.602 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-06T15:00:02.642 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-06T15:00:02.777 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-06T15:00:02.803 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-06T15:00:02.851 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-06T15:00:02.903 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2024-09-06T15:00:02.929 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-06T15:00:02.990 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-06T15:00:03.155 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-06T15:00:03.181 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:03.221 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:03.593 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-06T15:00:03.620 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:03.660 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:03.979 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-06T15:00:04.006 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-06T15:00:04.046 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-06T15:00:04.123 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2024-09-06T15:00:04.150 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-06T15:00:04.189 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-06T15:00:04.349 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-openssl. 2024-09-06T15:00:04.375 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-06T15:00:04.415 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-06T15:00:04.492 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2024-09-06T15:00:04.519 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-06T15:00:04.559 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-06T15:00:04.693 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr. 2024-09-06T15:00:04.720 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:04.751 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:04.870 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-06T15:00:04.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-06T15:00:04.937 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-06T15:00:05.139 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mon. 2024-09-06T15:00:05.165 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:05.205 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:05.214 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-06T15:00:05.230 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:05.273 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:05.619 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-06T15:00:05.634 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:05.669 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:05.825 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-osd. 2024-09-06T15:00:05.851 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:05.891 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:05.988 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-06T15:00:06.015 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-06T15:00:06.055 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-06T15:00:06.383 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2024-09-06T15:00:06.409 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-06T15:00:06.449 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-06T15:00:06.777 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2024-09-06T15:00:06.804 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:06.844 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:06.936 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph. 2024-09-06T15:00:06.952 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../066-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:06.986 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:07.205 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2024-09-06T15:00:07.221 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:07.255 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:07.297 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-fuse. 2024-09-06T15:00:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:07.389 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:07.767 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mds. 2024-09-06T15:00:07.794 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:07.833 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:08.033 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2024-09-06T15:00:08.060 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:08.100 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:08.220 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephadm. 2024-09-06T15:00:08.236 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../069-cephadm_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:08.270 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:08.548 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-06T15:00:08.574 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-06T15:00:08.614 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-06T15:00:08.942 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-06T15:00:08.957 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-06T15:00:08.992 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:09.195 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2024-09-06T15:00:09.222 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-ceph_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:09.261 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:09.572 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2024-09-06T15:00:09.599 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:09.653 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:10.005 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-babel. 2024-09-06T15:00:10.008 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2024-09-06T15:00:10.031 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-06T15:00:10.035 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:10.072 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:10.074 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:10.391 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jinja2. 2024-09-06T15:00:10.418 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-06T15:00:10.458 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-06T15:00:10.469 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2024-09-06T15:00:10.497 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-cephadm_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:10.536 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:10.811 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-06T15:00:10.828 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:10.864 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-06T15:00:10.869 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:10.891 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-06T15:00:10.930 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-06T15:00:11.223 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-06T15:00:11.241 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-06T15:00:11.249 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-06T15:00:11.268 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-06T15:00:11.292 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-06T15:00:11.307 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:11.575 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-routes. 2024-09-06T15:00:11.602 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-06T15:00:11.633 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-06T15:00:11.962 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-06T15:00:11.988 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:12.028 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:12.321 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2024-09-06T15:00:12.348 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-06T15:00:12.387 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:12.699 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2024-09-06T15:00:12.726 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-06T15:00:12.756 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-06T15:00:13.093 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-06T15:00:13.121 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:13.151 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:13.547 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-06T15:00:13.574 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-06T15:00:13.613 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-06T15:00:13.849 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2024-09-06T15:00:13.876 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-06T15:00:13.915 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-06T15:00:14.227 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-06T15:00:14.254 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:14.285 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:14.908 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-06T15:00:14.925 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-06T15:00:14.966 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-06T15:00:15.456 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-joblib. 2024-09-06T15:00:15.483 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-06T15:00:15.522 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-06T15:00:15.892 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-06T15:00:15.919 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-06T15:00:15.958 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-06T15:00:16.261 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn. 2024-09-06T15:00:16.288 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-06T15:00:16.327 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-06T15:00:17.061 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-06T15:00:17.089 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:17.173 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-06T15:00:17.190 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-06T15:00:17.213 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:17.232 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-06T15:00:17.718 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2024-09-06T15:00:17.745 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-06T15:00:17.776 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-06T15:00:18.142 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cachetools. 2024-09-06T15:00:18.169 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-06T15:00:18.209 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-06T15:00:18.321 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-06T15:00:18.349 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-06T15:00:18.387 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-06T15:00:18.487 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-06T15:00:18.514 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-06T15:00:18.545 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-06T15:00:18.674 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2024-09-06T15:00:18.701 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-06T15:00:18.740 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-06T15:00:18.823 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-06T15:00:18.839 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-06T15:00:18.906 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-06T15:00:19.209 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rsa. 2024-09-06T15:00:19.237 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-06T15:00:19.277 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-06T15:00:19.485 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-06T15:00:19.510 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:19.605 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-google-auth. 2024-09-06T15:00:19.632 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-06T15:00:19.634 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:19.671 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-06T15:00:19.991 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-06T15:00:20.019 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-06T15:00:20.058 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-06T15:00:20.369 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-websocket. 2024-09-06T15:00:20.397 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-06T15:00:20.435 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-06T15:00:20.604 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2024-09-06T15:00:20.631 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-06T15:00:20.662 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-06T15:00:20.731 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-06T15:00:20.758 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-06T15:00:20.797 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-06T15:00:20.931 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-06T15:00:20.959 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-06T15:00:20.998 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-06T15:00:21.326 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-06T15:00:21.354 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-06T15:00:21.401 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-06T15:00:21.402 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-06T15:00:21.419 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:21.452 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:21.704 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2024-09-06T15:00:21.732 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-06T15:00:21.770 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-06T15:00:21.788 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-06T15:00:21.817 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-06T15:00:21.855 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-06T15:00:22.090 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2024-09-06T15:00:22.107 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-06T15:00:22.149 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-06T15:00:22.175 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-06T15:00:22.203 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-06T15:00:22.241 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-06T15:00:22.461 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-06T15:00:22.488 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-06T15:00:22.502 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package jq. 2024-09-06T15:00:22.527 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-06T15:00:22.530 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-06T15:00:22.569 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-06T15:00:22.838 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package socat. 2024-09-06T15:00:22.839 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2024-09-06T15:00:22.854 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-06T15:00:22.866 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-06T15:00:22.896 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-06T15:00:22.904 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-06T15:00:23.191 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package xmlstarlet. 2024-09-06T15:00:23.208 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-06T15:00:23.224 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-06T15:00:23.249 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-06T15:00:23.252 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-06T15:00:23.291 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-06T15:00:23.604 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-test. 2024-09-06T15:00:23.620 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:23.662 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:23.913 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-06T15:00:23.942 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:23.979 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:24.299 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-06T15:00:24.327 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-06T15:00:24.365 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-06T15:00:24.676 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-06T15:00:24.693 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-06T15:00:24.743 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-06T15:00:24.988 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2024-09-06T15:00:25.016 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-06T15:00:25.054 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-06T15:00:25.331 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2024-09-06T15:00:25.348 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-06T15:00:25.389 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-06T15:00:25.701 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2024-09-06T15:00:25.729 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-06T15:00:25.767 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-06T15:00:26.097 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2024-09-06T15:00:26.113 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:26.146 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:26.199 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-volume. 2024-09-06T15:00:26.227 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:26.266 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:26.595 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-06T15:00:26.623 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:26.661 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:26.989 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-06T15:00:27.017 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-06T15:00:27.056 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-06T15:00:27.360 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-06T15:00:27.388 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-06T15:00:27.418 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-06T15:00:27.790 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package nvme-cli. 2024-09-06T15:00:27.818 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-06T15:00:27.873 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-06T15:00:28.294 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package pkg-config. 2024-09-06T15:00:28.323 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-06T15:00:28.361 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-06T15:00:28.622 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-06T15:00:28.638 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-06T15:00:28.680 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-06T15:00:28.776 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4704-g8b38c33c-1jammy_all.deb ... 2024-09-06T15:00:28.842 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:29.100 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-06T15:00:29.128 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-06T15:00:29.129 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-06T15:00:29.146 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:29.166 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-06T15:00:29.187 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:29.444 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastescript. 2024-09-06T15:00:29.460 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-06T15:00:29.502 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-06T15:00:29.507 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-06T15:00:29.535 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-06T15:00:29.573 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-06T15:00:29.773 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pluggy. 2024-09-06T15:00:29.801 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-06T15:00:29.831 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-06T15:00:29.953 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-06T15:00:29.981 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-06T15:00:30.019 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-06T15:00:30.134 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-psutil. 2024-09-06T15:00:30.162 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-06T15:00:30.340 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2024-09-06T15:00:30.368 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-06T15:00:30.398 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-06T15:00:30.553 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-py. 2024-09-06T15:00:30.581 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-06T15:00:30.619 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-06T15:00:30.803 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pkg-config. 2024-09-06T15:00:30.832 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-06T15:00:30.869 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-06T15:00:30.940 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pygments. 2024-09-06T15:00:30.968 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-06T15:00:31.006 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-06T15:00:31.131 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-06T15:00:31.159 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-06T15:00:31.197 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-06T15:00:31.477 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-06T15:00:31.505 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-06T15:00:31.543 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-06T15:00:31.609 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-06T15:00:31.637 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-06T15:00:31.675 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-06T15:00:31.846 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-toml. 2024-09-06T15:00:31.874 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-06T15:00:31.913 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-06T15:00:31.986 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2024-09-06T15:00:32.014 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-06T15:00:32.052 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-06T15:00:32.182 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pytest. 2024-09-06T15:00:32.198 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-06T15:00:32.232 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-06T15:00:32.373 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2024-09-06T15:00:32.401 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-06T15:00:32.439 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-06T15:00:32.586 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplejson. 2024-09-06T15:00:32.614 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-06T15:00:32.652 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-06T15:00:32.742 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2024-09-06T15:00:32.770 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-06T15:00:32.808 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-06T15:00:32.930 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-06T15:00:32.958 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-06T15:00:32.996 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-06T15:00:33.128 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2024-09-06T15:00:33.156 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-06T15:00:33.219 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-06T15:00:33.548 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2024-09-06T15:00:33.576 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-06T15:00:33.614 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-06T15:00:33.733 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package radosgw. 2024-09-06T15:00:33.750 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../116-radosgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:33.791 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:34.110 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-06T15:00:34.138 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-06T15:00:34.176 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-06T15:00:34.470 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2024-09-06T15:00:34.486 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-06T15:00:34.528 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-06T15:00:34.703 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package rbd-fuse. 2024-09-06T15:00:34.719 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:34.761 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:34.765 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2024-09-06T15:00:34.793 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-06T15:00:34.831 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-06T15:00:35.057 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-06T15:00:35.143 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2024-09-06T15:00:35.171 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-06T15:00:35.209 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-06T15:00:35.316 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-06T15:00:35.417 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-06T15:00:35.472 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-06T15:00:35.500 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-06T15:00:35.547 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-06T15:00:35.668 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-06T15:00:36.023 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-06T15:00:36.251 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2024-09-06T15:00:36.279 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../116-radosgw_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:36.317 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:36.466 INFO:teuthology.orchestra.run.smithi189.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-06T15:00:36.527 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:37.011 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user cephadm....done 2024-09-06T15:00:37.125 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-06T15:00:37.220 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2024-09-06T15:00:37.237 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4704-g8b38c33c-1jammy_amd64.deb ... 2024-09-06T15:00:37.278 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:37.401 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-06T15:00:37.590 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-06T15:00:37.652 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-06T15:00:37.778 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-06T15:00:37.849 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-06T15:00:37.951 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-06T15:00:38.046 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-06T15:00:38.193 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-06T15:00:38.356 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-06T15:00:38.482 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-06T15:00:38.554 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-06T15:00:38.775 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-06T15:00:38.979 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-06T15:00:39.052 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:39.135 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-06T15:00:39.395 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-06T15:00:39.627 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2024-09-06T15:00:39.663 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-06T15:00:39.758 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-06T15:00:39.915 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-06T15:00:40.068 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-06T15:00:40.327 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-06T15:00:40.416 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-06T15:00:40.445 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-06T15:00:40.692 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-06T15:00:40.696 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-06T15:00:40.942 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:40.997 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-06T15:00:41.148 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-06T15:00:41.202 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-06T15:00:41.328 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-06T15:00:41.463 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-06T15:00:41.483 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-06T15:00:41.588 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-06T15:00:41.844 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-06T15:00:41.847 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-06T15:00:42.095 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-06T15:00:42.306 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-06T15:00:42.337 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-06T15:00:42.354 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-06T15:00:42.401 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-06T15:00:42.527 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-06T15:00:42.631 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-06T15:00:42.887 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:42.898 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-06T15:00:43.013 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-06T15:00:43.158 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-06T15:00:43.280 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-06T15:00:43.442 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:43.531 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-06T15:00:43.701 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-06T15:00:43.816 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up zip (3.0-12build2) ... 2024-09-06T15:00:43.827 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-06T15:00:43.934 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-06T15:00:43.937 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-06T15:00:44.038 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-06T15:00:44.280 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-06T15:00:44.619 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-06T15:00:44.677 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-06T15:00:44.711 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-06T15:00:44.775 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-06T15:00:44.878 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-06T15:00:44.901 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-06T15:00:45.013 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-06T15:00:45.139 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-06T15:00:45.260 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:45.395 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-06T15:00:45.431 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-06T15:00:45.655 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-06T15:00:45.808 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-06T15:00:45.914 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-06T15:00:46.050 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-06T15:00:46.232 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up zip (3.0-12build2) ... 2024-09-06T15:00:46.358 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-06T15:00:46.418 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-06T15:00:46.720 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-06T15:00:47.051 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-06T15:00:47.063 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-06T15:00:47.311 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-06T15:00:47.314 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-06T15:00:47.415 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:47.445 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-06T15:00:47.579 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-06T15:00:47.691 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-06T15:00:47.889 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-06T15:00:48.009 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-06T15:00:48.322 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-06T15:00:48.683 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-06T15:00:49.076 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-06T15:00:49.281 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-06T15:00:49.369 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-06T15:00:49.499 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:49.651 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-06T15:00:49.712 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-06T15:00:49.910 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-06T15:00:49.955 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-06T15:00:50.036 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-06T15:00:50.106 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:50.162 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-06T15:00:50.424 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-06T15:00:50.489 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-06T15:00:50.740 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-06T15:00:50.741 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-06T15:00:50.974 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:51.092 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-06T15:00:51.418 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-06T15:00:51.669 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-06T15:00:51.889 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-06T15:00:51.954 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-06T15:00:52.132 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:52.213 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-06T15:00:52.266 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-06T15:00:52.464 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-06T15:00:52.525 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-06T15:00:52.651 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-06T15:00:52.707 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-06T15:00:52.777 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-06T15:00:52.825 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-06T15:00:53.079 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-06T15:00:53.101 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-06T15:00:53.227 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-06T15:00:53.380 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-06T15:00:53.511 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-06T15:00:53.639 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:53.790 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-06T15:00:53.804 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-06T15:00:54.055 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-06T15:00:54.108 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-06T15:00:54.164 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-06T15:00:54.266 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:54.338 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-06T15:00:54.359 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-06T15:00:54.575 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-06T15:00:54.619 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-06T15:00:54.701 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-06T15:00:54.853 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-06T15:00:55.094 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-06T15:00:55.121 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-06T15:00:55.363 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-06T15:00:55.397 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-06T15:00:55.489 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-06T15:00:55.523 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-06T15:00:55.731 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:55.808 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-06T15:00:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-06T15:00:55.942 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-06T15:00:56.166 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-06T15:00:56.243 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-06T15:00:56.467 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-06T15:00:56.536 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-06T15:00:56.744 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-06T15:00:56.787 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-06T15:00:56.870 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-06T15:00:56.896 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-06T15:00:57.022 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-06T15:00:57.111 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-06T15:00:57.146 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-06T15:00:57.349 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-06T15:00:57.422 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-06T15:00:57.491 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-06T15:00:57.750 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-06T15:00:57.885 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-06T15:00:58.144 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-06T15:00:58.152 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-06T15:00:58.279 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-06T15:00:58.437 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-06T15:00:58.538 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-06T15:00:58.689 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-06T15:00:58.781 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-06T15:00:58.882 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:58.991 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:59.023 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-06T15:00:59.118 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-06T15:00:59.456 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:59.531 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-06T15:00:59.566 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:00:59.666 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-06T15:00:59.934 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:00.059 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-06T15:01:00.060 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:00.185 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-06T15:01:00.186 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:00.407 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-06T15:01:00.407 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-06T15:01:00.461 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-06T15:01:00.720 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-06T15:01:01.048 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-06T15:01:01.114 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:01.289 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:01.390 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:01.458 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-06T15:01:01.491 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-06T15:01:01.751 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-06T15:01:02.079 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-06T15:01:02.197 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.323 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.449 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-06T15:01:02.711 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.785 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.837 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.911 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:02.963 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.012 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-06T15:01:03.089 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.190 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.263 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.364 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.490 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:03.691 INFO:teuthology.orchestra.run.smithi189.stdout:Adding group ceph....done 2024-09-06T15:01:03.703 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-06T15:01:03.703 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-06T15:01:04.043 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user ceph....done 2024-09-06T15:01:04.200 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:04.211 INFO:teuthology.orchestra.run.smithi189.stdout:Setting system user ceph properties....done 2024-09-06T15:01:04.231 INFO:teuthology.orchestra.run.smithi189.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-06T15:01:04.326 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:04.364 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-06T15:01:04.452 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:04.577 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-06T15:01:04.687 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-06T15:01:05.166 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:05.284 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:05.723 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:05.741 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-06T15:01:05.742 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-06T15:01:05.849 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:05.975 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:06.101 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:06.178 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:06.227 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:06.529 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-06T15:01:06.728 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2024-09-06T15:01:07.005 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:07.104 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2024-09-06T15:01:07.215 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-06T15:01:07.215 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-06T15:01:07.264 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2024-09-06T15:01:07.277 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-06T15:01:07.417 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-06T15:01:07.682 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:07.772 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-06T15:01:07.881 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-06T15:01:07.882 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-06T15:01:08.261 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:08.341 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:08.404 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:08.621 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-06T15:01:08.621 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-06T15:01:08.867 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-06T15:01:08.868 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-06T15:01:09.085 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:09.211 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:09.362 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:09.398 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:09.576 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-06T15:01:09.576 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-06T15:01:09.755 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-06T15:01:10.096 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:10.225 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:10.256 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:10.357 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:10.451 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-06T15:01:10.451 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-06T15:01:10.483 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:10.836 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-06T15:01:10.935 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:11.037 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-06T15:01:11.149 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-06T15:01:11.149 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-06T15:01:11.189 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-06T15:01:11.628 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:11.871 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-06T15:01:11.871 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-06T15:01:12.324 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-06T15:01:12.364 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:12.616 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:12.867 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:12.983 INFO:teuthology.orchestra.run.smithi189.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-06T15:01:12.990 DEBUG:teuthology.parallel:result is None 2024-09-06T15:01:13.127 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-06T15:01:13.127 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-06T15:01:13.609 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:13.752 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:13.878 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:14.012 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (19.3.0-4704-g8b38c33c-1jammy) ... 2024-09-06T15:01:14.348 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-06T15:01:14.457 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-06T15:01:14.609 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-06T15:01:15.569 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-06T15:01:16.201 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-06T15:01:16.206 DEBUG:teuthology.parallel:result is None 2024-09-06T15:01:16.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:01:16.358 DEBUG:teuthology.orchestra.run.smithi189:> dpkg-query -W -f '${Version}' ceph 2024-09-06T15:01:16.378 INFO:teuthology.orchestra.run.smithi189.stdout:19.3.0-4704-g8b38c33c-1jammy 2024-09-06T15:01:16.378 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704-g8b38c33c-1jammy 2024-09-06T15:01:16.378 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704-g8b38c33c-1jammy is installed. 2024-09-06T15:01:16.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:01:16.532 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2024-09-06T15:01:16.551 INFO:teuthology.orchestra.run.smithi190.stdout:19.3.0-4704-g8b38c33c-1jammy 2024-09-06T15:01:16.551 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4704-g8b38c33c-1jammy 2024-09-06T15:01:16.551 INFO:teuthology.task.install:The correct ceph version 19.3.0-4704-g8b38c33c-1jammy is installed. 2024-09-06T15:01:16.553 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-06T15:01:16.583 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:01:16.583 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-06T15:01:16.614 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:01:16.614 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-06T15:01:16.629 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-06T15:01:16.644 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:01:16.645 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-06T15:01:16.705 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-06T15:01:16.759 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:01:16.759 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-09-06T15:01:16.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-06T15:01:16.825 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-06T15:01:16.825 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:01:16.825 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-06T15:01:16.873 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-06T15:01:16.927 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:01:16.927 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-06T15:01:16.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-06T15:01:16.993 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-06T15:01:16.993 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:01:16.993 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-06T15:01:17.006 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-06T15:01:17.059 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:01:17.059 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-09-06T15:01:17.072 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-06T15:01:17.124 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-06T15:01:17.222 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', 'CEPHADM_STRAY_DAEMON'], 'log-only-match': ['CEPHADM_'], 'mon_bind_msgr2': False, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'cephadm_mode': 'root'} 2024-09-06T15:01:17.222 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:01:17.223 INFO:tasks.cephadm:Cluster fsid is de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:01:17.223 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-06T15:01:17.223 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.189:6789]', 'mon.c': '[v1:172.21.15.189:6790]', 'mon.b': '[v1:172.21.15.190:6789]'} 2024-09-06T15:01:17.223 INFO:tasks.cephadm:First mon is mon.a on smithi189 2024-09-06T15:01:17.223 INFO:tasks.cephadm:First mgr is y 2024-09-06T15:01:17.223 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-06T15:01:17.224 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-06T15:01:17.238 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname $(hostname -s) 2024-09-06T15:01:17.253 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-06T15:01:17.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:01:17.408 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/82769/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4704-g8b38c33c', 'node_name': '172.21.2.9+braggi09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4704-g8b38c33c-1jammy'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-09-04 19:43:57.745461', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-athakkar-testing-2024-09-04-1837', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-09-06T15:01:17.557 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-athakkar-testing-2024-09-04-1837, sha1 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:01:17.559 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-06T15:01:17.559 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-09-06T15:01:17.559 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.050 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-rw-r-- 1 ubuntu ubuntu 810214 Sep 6 15:01 /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.051 DEBUG:teuthology.orchestra.run.smithi190:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.553 INFO:teuthology.orchestra.run.smithi190.stdout:-rw-rw-r-- 1 ubuntu ubuntu 810214 Sep 6 15:01 /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.553 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.561 DEBUG:teuthology.orchestra.run.smithi190:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-06T15:01:18.609 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 on all hosts... 2024-09-06T15:01:18.610 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 pull 2024-09-06T15:01:18.612 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 pull 2024-09-06T15:01:18.797 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73... 2024-09-06T15:01:18.797 INFO:teuthology.orchestra.run.smithi190.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73... 2024-09-06T15:02:18.324 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)", 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110", 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30" 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-06T15:02:18.325 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)", 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout: "image_id": "1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110", 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout: "repo_digests": [ 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30" 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout: ] 2024-09-06T15:02:24.208 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-09-06T15:02:24.251 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-06T15:02:24.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph 2024-09-06T15:02:24.280 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-06T15:02:24.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /etc/ceph 2024-09-06T15:02:24.335 INFO:tasks.cephadm:Writing seed config... 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [global] ms type = async 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-06T15:02:24.336 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-09-06T15:02:24.337 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-06T15:02:24.338 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:02:24.338 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-06T15:02:24.367 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = de31ad16-6c60-11ef-bce4-c7b262605968 mon election default strategy = 3 ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-09-06T15:02:24.368 DEBUG:teuthology.orchestra.run.smithi189:mon.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service 2024-09-06T15:02:24.413 DEBUG:teuthology.orchestra.run.smithi189:mgr.y> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y.service 2024-09-06T15:02:24.455 INFO:tasks.cephadm:Bootstrapping... 2024-09-06T15:02:24.456 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -v bootstrap --fsid de31ad16-6c60-11ef-bce4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.189:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:02:24.685 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-06T15:02:24.685 INFO:teuthology.orchestra.run.smithi189.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', '-v', 'bootstrap', '--fsid', 'de31ad16-6c60-11ef-bce4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.189:6789]', '--skip-admin-label'] 2024-09-06T15:02:24.685 INFO:teuthology.orchestra.run.smithi189.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-06T15:02:24.686 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying podman|docker is present... 2024-09-06T15:02:24.686 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying lvm2 is present... 2024-09-06T15:02:24.686 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying time synchronization is in place... 2024-09-06T15:02:24.690 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-06T15:02:24.690 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-06T15:02:24.694 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-06T15:02:24.694 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.699 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-06T15:02:24.699 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-06T15:02:24.702 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-06T15:02:24.702 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.705 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-06T15:02:24.706 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout masked 2024-09-06T15:02:24.708 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-06T15:02:24.708 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.712 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-06T15:02:24.712 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-06T15:02:24.715 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-06T15:02:24.715 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.720 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout enabled 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout active 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:Unit ntp.service is enabled and running 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:Repeating the final host check... 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:docker (/usr/bin/docker) is present 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl is present 2024-09-06T15:02:24.724 INFO:teuthology.orchestra.run.smithi189.stdout:lvcreate is present 2024-09-06T15:02:24.727 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-06T15:02:24.727 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-06T15:02:24.730 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-06T15:02:24.730 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.734 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-06T15:02:24.734 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-06T15:02:24.737 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-06T15:02:24.737 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.740 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-06T15:02:24.741 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout masked 2024-09-06T15:02:24.744 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-06T15:02:24.744 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.747 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-06T15:02:24.747 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-06T15:02:24.750 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-06T15:02:24.751 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout inactive 2024-09-06T15:02:24.754 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout enabled 2024-09-06T15:02:24.758 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stdout active 2024-09-06T15:02:24.758 INFO:teuthology.orchestra.run.smithi189.stdout:Unit ntp.service is enabled and running 2024-09-06T15:02:24.758 INFO:teuthology.orchestra.run.smithi189.stdout:Host looks OK 2024-09-06T15:02:24.758 INFO:teuthology.orchestra.run.smithi189.stdout:Cluster fsid: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:24.759 INFO:teuthology.orchestra.run.smithi189.stdout:Acquiring lock 140594796377328 on /run/cephadm/de31ad16-6c60-11ef-bce4-c7b262605968.lock 2024-09-06T15:02:24.759 INFO:teuthology.orchestra.run.smithi189.stdout:Lock 140594796377328 acquired on /run/cephadm/de31ad16-6c60-11ef-bce4-c7b262605968.lock 2024-09-06T15:02:24.759 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying IP 172.21.15.189 port 6789 ... 2024-09-06T15:02:24.759 INFO:teuthology.orchestra.run.smithi189.stdout:Base mon IP(s) is [172.21.15.189:6789], mon addrv is [v1:172.21.15.189:6789] 2024-09-06T15:02:24.761 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.189 metric 100 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 158.69.67.47 via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.189 metric 100 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.189 metric 100 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.189 metric 100 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.189 metric 100 2024-09-06T15:02:24.762 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.189 metric 100 2024-09-06T15:02:24.764 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-06T15:02:24.764 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-09-06T15:02:24.764 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1749sec pref medium 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:6df1/64 scope link 2024-09-06T15:02:24.766 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-06T15:02:24.767 INFO:teuthology.orchestra.run.smithi189.stdout:Mon IP `172.21.15.189` is in CIDR network `172.21.0.0/20` 2024-09-06T15:02:24.767 INFO:teuthology.orchestra.run.smithi189.stdout:Mon IP `172.21.15.189` is in CIDR network `172.21.0.1/32` 2024-09-06T15:02:24.767 INFO:teuthology.orchestra.run.smithi189.stdout:Mon IP `172.21.15.189` is in CIDR network `172.21.0.2/32` 2024-09-06T15:02:24.767 INFO:teuthology.orchestra.run.smithi189.stdout:Mon IP `172.21.15.189` is in CIDR network `172.21.15.254/32` 2024-09-06T15:02:24.768 INFO:teuthology.orchestra.run.smithi189.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.1/32', '172.21.0.2/32', '172.21.15.254/32'] 2024-09-06T15:02:24.768 INFO:teuthology.orchestra.run.smithi189.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-06T15:02:24.768 INFO:teuthology.orchestra.run.smithi189.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73... 2024-09-06T15:02:24.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/docker: stdout 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73: Pulling from ceph-ci/ceph 2024-09-06T15:02:24.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/docker: stdout Digest: sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:02:24.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:02:24.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T15:02:26.521 INFO:teuthology.orchestra.run.smithi189.stdout:ceph: stdout ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev) 2024-09-06T15:02:26.521 INFO:teuthology.orchestra.run.smithi189.stdout:Ceph version: ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev) 2024-09-06T15:02:26.521 INFO:teuthology.orchestra.run.smithi189.stdout:Extracting ceph user uid/gid from container image... 2024-09-06T15:02:27.960 INFO:teuthology.orchestra.run.smithi189.stdout:stat: stdout 167 167 2024-09-06T15:02:27.960 INFO:teuthology.orchestra.run.smithi189.stdout:Creating initial keys... 2024-09-06T15:02:29.324 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-authtool: stdout AQCEGdtm1eEsMBAAK0AddPxxbFxdFco6dnbXNw== 2024-09-06T15:02:30.789 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-authtool: stdout AQCGGdtmawUrERAA0rZtcKSjiUbiRyGFMHOq8w== 2024-09-06T15:02:32.204 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-authtool: stdout AQCHGdtm/ItHKBAA5cHB9KJA9JemXNHcarQjZA== 2024-09-06T15:02:32.205 INFO:teuthology.orchestra.run.smithi189.stdout:Creating initial monmap... 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:monmaptool for a [v1:172.21.15.189:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:setting min_mon_release = quincy 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: set fsid to de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:33.694 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-06T15:02:33.695 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:02:33.695 INFO:teuthology.orchestra.run.smithi189.stdout:Creating mon... 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.620+0000 7fe07b790c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.620+0000 7fe07b790c80 1 imported monmap: 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:02:35.169 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.620+0000 7fe07b790c80 0 /usr/bin/ceph-mon: set fsid to de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Git sha 0 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Compile date 2024-09-04 13:52:53 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: DB SUMMARY 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: DB Session ID: TK1WKUD1AQORPDG2PI5Q 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-06T15:02:35.170 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.error_if_exists: 0 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.create_if_missing: 1 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.env: 0x563ae7e60160 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.info_log: 0x563ae9a82d80 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.statistics: (nil) 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.use_fsync: 0 2024-09-06T15:02:35.171 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.db_log_dir: 2024-09-06T15:02:35.172 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.wal_dir: 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.write_buffer_manager: 0x563ae9a7b540 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-06T15:02:35.173 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.unordered_write: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.row_cache: None 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.wal_filter: None 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-06T15:02:35.174 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.two_write_queues: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.wal_compression: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.atomic_flush: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-06T15:02:35.175 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T15:02:35.176 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_open_files: -1 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Compression algorithms supported: 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kZSTD supported: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kXpressCompression supported: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kZlibCompression supported: 1 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-06T15:02:35.177 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.merge_operator: 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_filter: None 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-06T15:02:35.178 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563ae9a829a0) 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-06T15:02:35.179 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x563ae9a6a850 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-06T15:02:35.180 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-06T15:02:35.181 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression: NoCompression 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.num_levels: 7 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:02:35.182 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T15:02:35.183 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T15:02:35.184 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T15:02:35.185 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.bloom_locality: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-06T15:02:35.186 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.ttl: 2592000 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enable_blob_files: false 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.min_blob_size: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T15:02:35.187 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.624+0000 7fe07b790c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: eeec2af3-c20c-4b16-908b-d5750f3cbabf 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563ae9a9ae00 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: DB pointer 0x563ae9b7c000 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe072f1b640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T15:02:35.188 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe072f1b640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-06T15:02:35.189 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T15:02:35.190 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x563ae9a6a850#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-06T15:02:34.628+0000 7fe07b790c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-06T15:02:35.191 INFO:teuthology.orchestra.run.smithi189.stdout:create mon.a on 2024-09-06T15:02:35.425 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-09-06T15:02:35.622 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-06T15:02:35.853 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target -> /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target. 2024-09-06T15:02:35.853 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target -> /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target. 2024-09-06T15:02:36.135 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a 2024-09-06T15:02:36.135 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to reset failed state of unit ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service: Unit ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service not loaded. 2024-09-06T15:02:36.318 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target.wants/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service. 2024-09-06T15:02:36.327 INFO:teuthology.orchestra.run.smithi189.stdout:firewalld does not appear to be present 2024-09-06T15:02:36.327 INFO:teuthology.orchestra.run.smithi189.stdout:Not possible to enable service . firewalld.service is not available 2024-09-06T15:02:36.327 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mon to start... 2024-09-06T15:02:36.327 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mon... 2024-09-06T15:02:38.224 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:37 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.934278+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout cluster: 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout id: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout services: 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.261539s) 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-06T15:02:38.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout data: 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout pgs: 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.088+0000 7f34dddf9640 1 Processor -- start 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.088+0000 7f34dddf9640 1 -- start start 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f34d810a960 con 0x7f34d81064e0 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d77fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f34d81064e0 0x7f34d81068e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:46430/0 (socket says 172.21.15.189:46430) 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d77fe640 1 -- 172.21.15.189:0/1771684412 learned_addr learned my addr 172.21.15.189:0/1771684412 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577009175 0 0) 0x7f34d810a960 con 0x7f34d81064e0 2024-09-06T15:02:38.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c0003520 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 743749409 0 0) 0x7f34c0003520 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d810bb40 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f34c8001600 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34c80018a0 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d67fc640 1 -- 172.21.15.189:0/1771684412 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f34c8001ca0 con 0x7f34d81064e0 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1771684412 >> v1:172.21.15.189:6789/0 conn(0x7f34d81064e0 legacy=0x7f34d81068e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1771684412 shutdown_connections 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1771684412 >> 172.21.15.189:0/1771684412 conn(0x7f34d8101e30 msgr2=0x7f34d8104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1771684412 shutdown_connections 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1771684412 wait complete. 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 Processor -- start 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- start start 2024-09-06T15:02:38.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f34d807c890 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d77fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f34d81064e0 0x7f34d807c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:46434/0 (socket says 172.21.15.189:46434) 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d77fe640 1 -- 172.21.15.189:0/1338093114 learned_addr learned my addr 172.21.15.189:0/1338093114 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204478273 0 0) 0x7f34d807c890 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c0003160 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 489806767 0 0) 0x7f34c0003160 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34d807c890 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f34c8001b60 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3556895418 0 0) 0x7f34d807c890 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d81a0980 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34d819f9d0 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.092+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f34d819ff10 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34c80018a0 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f34c8004d00 con 0x7f34d81064e0 2024-09-06T15:02:38.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f34c80052b0 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f34c8006810 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c40050b0 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.096+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f34c8006ab0 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "status"} v 0) -- 0x7f34c4005bb0 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34d4ff9640 1 -- 172.21.15.189:0/1338093114 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (unknown 1155462804 0 52823554) 0x7f34c8005840 con 0x7f34d81064e0 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 >> v1:172.21.15.189:6789/0 conn(0x7f34d81064e0 legacy=0x7f34d807c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 shutdown_connections 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 >> 172.21.15.189:0/1338093114 conn(0x7f34d8101e30 msgr2=0x7f34d8190a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 shutdown_connections 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:38.212+0000 7f34dddf9640 1 -- 172.21.15.189:0/1338093114 wait complete. 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:mon is available 2024-09-06T15:02:38.756 INFO:teuthology.orchestra.run.smithi189.stdout:Assimilating anything we can from ceph.conf... 2024-09-06T15:02:39.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955157+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-06T15:02:39.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955157+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955359+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955359+0000 mon.a (mon.0) 3 : cluster [DBG] monmap epoch 1 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955370+0000 mon.a (mon.0) 4 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955370+0000 mon.a (mon.0) 4 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955377+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955377+0000 mon.a (mon.0) 5 : cluster [DBG] last_changed 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955385+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955385+0000 mon.a (mon.0) 6 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955393+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955393+0000 mon.a (mon.0) 7 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955399+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955399+0000 mon.a (mon.0) 8 : cluster [DBG] election_strategy: 1 2024-09-06T15:02:39.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955406+0000 mon.a (mon.0) 9 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.955406+0000 mon.a (mon.0) 9 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.981839+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.981839+0000 mon.a (mon.0) 10 : cluster [DBG] fsmap 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.984240+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.984240+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.984763+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: cluster 2024-09-06T15:02:37.984763+0000 mon.a (mon.0) 12 : cluster [DBG] mgrmap e1: no daemons active 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: audit 2024-09-06T15:02:38.216656+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/1338093114' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-06T15:02:39.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:38 smithi189 bash[22278]: audit 2024-09-06T15:02:38.216656+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/1338093114' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-06T15:02:40.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:39 smithi189 bash[22278]: audit 2024-09-06T15:02:39.960600+0000 mon.a (mon.0) 14 : audit [INF] from='client.? v1:172.21.15.189:0/859039595' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-06T15:02:40.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:39 smithi189 bash[22278]: audit 2024-09-06T15:02:39.960600+0000 mon.a (mon.0) 14 : audit [INF] from='client.? v1:172.21.15.189:0/859039595' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-06T15:02:40.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:39 smithi189 bash[22278]: audit 2024-09-06T15:02:39.965392+0000 mon.a (mon.0) 15 : audit [INF] from='client.? v1:172.21.15.189:0/859039595' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-06T15:02:40.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:39 smithi189 bash[22278]: audit 2024-09-06T15:02:39.965392+0000 mon.a (mon.0) 15 : audit [INF] from='client.? v1:172.21.15.189:0/859039595' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [global] 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout fsid = de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.189:6789] 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-06T15:02:40.468 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [osd] 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-06T15:02:40.469 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a9453d640 1 Processor -- start 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a9453d640 1 -- start start 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a9453d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9a8c10a870 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a922d9640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9a8c079be0 0x7f9a8c1090c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56156/0 (socket says 172.21.15.189:56156) 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a922d9640 1 -- 172.21.15.189:0/267046363 learned_addr learned my addr 172.21.15.189:0/267046363 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206624300 0 0) 0x7f9a8c10a870 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a78003520 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1944524628 0 0) 0x7f9a78003520 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c10ba50 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.828+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9a88001600 con 0x7f9a8c079be0 2024-09-06T15:02:40.470 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a880018a0 con 0x7f9a8c079be0 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a912d7640 1 -- 172.21.15.189:0/267046363 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9a88001ca0 con 0x7f9a8c079be0 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/267046363 >> v1:172.21.15.189:6789/0 conn(0x7f9a8c079be0 legacy=0x7f9a8c1090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/267046363 shutdown_connections 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/267046363 >> 172.21.15.189:0/267046363 conn(0x7f9a8c100d30 msgr2=0x7f9a8c103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/267046363 shutdown_connections 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/267046363 wait complete. 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 Processor -- start 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- start start 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9a8c19a0b0 con 0x7f9a8c079be0 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a922d9640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9a8c079be0 0x7f9a8c199950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56158/0 (socket says 172.21.15.189:56158) 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a922d9640 1 -- 172.21.15.189:0/859039595 learned_addr learned my addr 172.21.15.189:0/859039595 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:40.471 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309090889 0 0) 0x7f9a8c19a0b0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a78003160 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2543720200 0 0) 0x7f9a78003160 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a8c19a0b0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9a88001b60 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3215935406 0 0) 0x7f9a8c19a0b0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c19a2a0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c19db80 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a8c19dfa0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a880018a0 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9a88004d40 con 0x7f9a8c079be0 2024-09-06T15:02:40.472 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f9a88005330 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f9a88006a20 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.832+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a700050b0 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.836+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f9a88005800 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.956+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9a70002420 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.960+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+354 (unknown 1213389831 0 1460885159) 0x7f9a880059e0 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a837fe640 1 -- 172.21.15.189:0/859039595 <== mon.0 v1:172.21.15.189:6789/0 11 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f9a88006010 con 0x7f9a8c079be0 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 >> v1:172.21.15.189:6789/0 conn(0x7f9a8c079be0 legacy=0x7f9a8c199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 shutdown_connections 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 >> 172.21.15.189:0/859039595 conn(0x7f9a8c100d30 msgr2=0x7f9a8c108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 shutdown_connections 2024-09-06T15:02:40.473 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:39.964+0000 7f9a9453d640 1 -- 172.21.15.189:0/859039595 wait complete. 2024-09-06T15:02:40.474 INFO:teuthology.orchestra.run.smithi189.stdout:Generating new minimal ceph.conf... 2024-09-06T15:02:41.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:41 smithi189 bash[22278]: audit 2024-09-06T15:02:41.584618+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? v1:172.21.15.189:0/2992258832' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:02:41.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:41 smithi189 bash[22278]: audit 2024-09-06T15:02:41.584618+0000 mon.a (mon.0) 16 : audit [DBG] from='client.? v1:172.21.15.189:0/2992258832' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.456+0000 7f98a08c0640 1 Processor -- start 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.456+0000 7f98a08c0640 1 -- start start 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.456+0000 7f98a08c0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f989c10a980 con 0x7f989c106500 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989a59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f989c106500 0x7f989c106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56166/0 (socket says 172.21.15.189:56166) 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989a59c640 1 -- 172.21.15.189:0/391470188 learned_addr learned my addr 172.21.15.189:0/391470188 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095510064 0 0) 0x7f989c10a980 con 0x7f989c106500 2024-09-06T15:02:42.118 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9884003520 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1578682752 0 0) 0x7f9884003520 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c10bb60 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f988c001600 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f988c001bf0 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989959a640 1 -- 172.21.15.189:0/391470188 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f988c0058d0 con 0x7f989c106500 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/391470188 >> v1:172.21.15.189:6789/0 conn(0x7f989c106500 legacy=0x7f989c106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/391470188 shutdown_connections 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/391470188 >> 172.21.15.189:0/391470188 conn(0x7f989c101e10 msgr2=0x7f989c104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:42.119 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/391470188 shutdown_connections 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/391470188 wait complete. 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 Processor -- start 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- start start 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f989c07c900 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989a59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f989c106500 0x7f989c07c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56174/0 (socket says 172.21.15.189:56174) 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f989a59c640 1 -- 172.21.15.189:0/2992258832 learned_addr learned my addr 172.21.15.189:0/2992258832 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978435391 0 0) 0x7f989c07c900 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98840055c0 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3764572064 0 0) 0x7f98840055c0 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f989c07c900 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f988c001080 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3086530500 0 0) 0x7f989c07c900 con 0x7f989c106500 2024-09-06T15:02:42.120 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c1a11e0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f989c1a0230 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f989c1a0770 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f988c0016c0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f988c005eb0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.460+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f988c0064e0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.464+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f988c007a10 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.464+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c0050b0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.464+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f988c005890 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f987c0053a0 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f988b7fe640 1 -- 172.21.15.189:0/2992258832 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+148 (unknown 1452402520 0 73950819) 0x7f988c001320 con 0x7f989c106500 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 >> v1:172.21.15.189:6789/0 conn(0x7f989c106500 legacy=0x7f989c07c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 shutdown_connections 2024-09-06T15:02:42.121 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 >> 172.21.15.189:0/2992258832 conn(0x7f989c101e10 msgr2=0x7f989c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:42.122 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 shutdown_connections 2024-09-06T15:02:42.122 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:41.580+0000 7f98a08c0640 1 -- 172.21.15.189:0/2992258832 wait complete. 2024-09-06T15:02:42.122 INFO:teuthology.orchestra.run.smithi189.stdout:Restarting the monitor... 2024-09-06T15:02:42.404 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 systemd[1]: Stopping Ceph mon.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:02:42.404 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 bash[22278]: debug 2024-09-06T15:02:42.232+0000 7f3770c5c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-06T15:02:42.404 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 bash[22278]: debug 2024-09-06T15:02:42.232+0000 7f3770c5c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-06T15:02:42.795 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 bash[22658]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-mon-a 2024-09-06T15:02:42.811 INFO:teuthology.orchestra.run.smithi189.stdout:Setting public_network to 172.21.0.1/32,172.21.0.0/20,172.21.0.2/32,172.21.15.254/32 in mon config section 2024-09-06T15:02:43.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 bash[22718]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-mon-a 2024-09-06T15:02:43.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-06T15:02:43.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 systemd[1]: Stopped Ceph mon.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:02:43.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:42 smithi189 systemd[1]: Started Ceph mon.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.228+0000 7ff6d815fc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.228+0000 7ff6d815fc80 0 ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev), process ceph-mon, pid 7 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.228+0000 7ff6d815fc80 0 pidfile_write: ignore empty --pid-file 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 0 load: jerasure load: lrc 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: RocksDB version: 7.9.2 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Git sha 0 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Compile date 2024-09-04 13:52:53 2024-09-06T15:02:44.417 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: DB SUMMARY 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: DB Session ID: ZERGDDN9A503481EMWAA 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: CURRENT file: CURRENT 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 88900 ; 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.error_if_exists: 0 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.create_if_missing: 0 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.paranoid_checks: 1 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T15:02:44.418 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.env: 0x5588333e3160 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.info_log: 0x558833cc3820 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.statistics: (nil) 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.use_fsync: 0 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_log_file_size: 0 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_fallocate: 1 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-06T15:02:44.419 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.use_direct_reads: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.db_log_dir: 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.wal_dir: 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-06T15:02:44.420 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.write_buffer_manager: 0x558833cc6e60 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T15:02:44.421 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-06T15:02:44.422 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.unordered_write: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.row_cache: None 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.wal_filter: None 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.two_write_queues: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-06T15:02:44.423 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.wal_compression: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.atomic_flush: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.log_readahead_size: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_background_jobs: 2 2024-09-06T15:02:44.424 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_background_compactions: -1 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_subcompactions: 1 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_open_files: -1 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-06T15:02:44.425 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.max_background_flushes: -1 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Compression algorithms supported: 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kZSTD supported: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kXpressCompression supported: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kBZip2Compression supported: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kLZ4Compression supported: 1 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kZlibCompression supported: 1 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: kSnappyCompression supported: 1 2024-09-06T15:02:44.426 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.merge_operator: 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.compaction_filter: None 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.232+0000 7ff6d815fc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558833cc3480) 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cache_index_and_filter_blocks: 1 2024-09-06T15:02:44.427 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: pin_top_level_index_and_filter: 1 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: index_type: 0 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: data_block_index_type: 0 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: index_shortening: 1 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: data_block_hash_table_util_ratio: 0.750000 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: checksum: 4 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: no_block_cache: 0 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_cache: 0x558833cb8850 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_cache_name: BinnedLRUCache 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_cache_options: 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: capacity : 536870912 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: num_shard_bits : 4 2024-09-06T15:02:44.428 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: strict_capacity_limit : 0 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: high_pri_pool_ratio: 0.000 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_cache_compressed: (nil) 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: persistent_cache: (nil) 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_size: 4096 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_size_deviation: 10 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_restart_interval: 16 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: index_block_restart_interval: 1 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: metadata_block_size: 4096 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: partition_filters: 0 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: use_delta_encoding: 1 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: filter_policy: bloomfilter 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: whole_key_filtering: 1 2024-09-06T15:02:44.429 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: verify_compression: 0 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: read_amp_bytes_per_bit: 0 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: format_version: 5 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: enable_index_compression: 1 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: block_align: 0 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: max_auto_readahead_size: 262144 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: prepopulate_block_cache: 0 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: initial_auto_readahead_size: 8192 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: num_file_reads_for_auto_readahead: 2 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression: NoCompression 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-06T15:02:44.430 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.num_levels: 7 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T15:02:44.431 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T15:02:44.432 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T15:02:44.433 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T15:02:44.434 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.inplace_update_support: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.bloom_locality: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.max_successive_merges: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-06T15:02:44.435 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.ttl: 2592000 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.enable_blob_files: false 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.min_blob_size: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-06T15:02:44.436 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: eeec2af3-c20c-4b16-908b-d5750f3cbabf 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725634964239733, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725634964240895, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85313, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 271, "table_properties": {"data_size": 83459, "index_size": 238, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10821, "raw_average_key_size": 47, "raw_value_size": 77322, "raw_average_value_size": 336, "num_data_blocks": 10, "num_entries": 230, "num_filter_entries": 230, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725634964, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "eeec2af3-c20c-4b16-908b-d5750f3cbabf", "db_session_id": "ZERGDDN9A503481EMWAA", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725634964241032, "job": 1, "event": "recovery_finished"} 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558833ce6e00 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.236+0000 7ff6d815fc80 4 rocksdb: DB pointer 0x558833dea000 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6cdf27640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6cdf27640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T15:02:44.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: ** DB Stats ** 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: ** Compaction Stats [default] ** 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: L0 2/0 85.14 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Sum 2/0 85.14 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:02:44.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: ** Compaction Stats [default] ** 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 114.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: AddFile(Total Files): cumulative 0, interval 0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: AddFile(Keys): cumulative 0, interval 0 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Cumulative compaction: 0.00 GB write, 19.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Interval compaction: 0.00 GB write, 19.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:02:44.439 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Block cache BinnedLRUCache@0x558833cb8850#7 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: ** File Read Latency Histogram By Level [default] ** 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 starting mon.a rank 0 at public addrs v1:172.21.15.189:6789/0 at bind addrs v1:172.21.15.189:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 1 mon.a@-1(???) e1 preinit fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).mds e1 new map 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).mds e1 print_map 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: e1 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: btime 2024-09-06T15:02:37:979262+0000 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: legacy client fscid: -1 2024-09-06T15:02:44.440 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: No filesystems configured 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: debug 2024-09-06T15:02:44.240+0000 7ff6d815fc80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248493+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248493+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248658+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248658+0000 mon.a (mon.0) 2 : cluster [DBG] monmap epoch 1 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248673+0000 mon.a (mon.0) 3 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248673+0000 mon.a (mon.0) 3 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:44.441 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248684+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248684+0000 mon.a (mon.0) 4 : cluster [DBG] last_changed 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248695+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248695+0000 mon.a (mon.0) 5 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248705+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248705+0000 mon.a (mon.0) 6 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248714+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248714+0000 mon.a (mon.0) 7 : cluster [DBG] election_strategy: 1 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248724+0000 mon.a (mon.0) 8 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.248724+0000 mon.a (mon.0) 8 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249127+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249127+0000 mon.a (mon.0) 9 : cluster [DBG] fsmap 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249164+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249164+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-06T15:02:44.442 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249533+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-06T15:02:44.443 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:44 smithi189 bash[22757]: cluster 2024-09-06T15:02:44.249533+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e1: no daemons active 2024-09-06T15:02:44.962 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f7180bbf640 1 Processor -- start 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f7180bbf640 1 -- start start 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f7180bbf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f717c10cc60 con 0x7f717c079a50 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717a59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f717c079a50 0x7f717c10b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56190/0 (socket says 172.21.15.189:56190) 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717a59c640 1 -- 172.21.15.189:0/3219788938 learned_addr learned my addr 172.21.15.189:0/3219788938 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270415214 0 0) 0x7f717c10cc60 con 0x7f717c079a50 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7164003520 con 0x7f717c079a50 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3340547956 0 0) 0x7f7164003520 con 0x7f717c079a50 2024-09-06T15:02:44.963 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c10de40 con 0x7f717c079a50 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7170001600 con 0x7f717c079a50 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f7170001cf0 con 0x7f717c079a50 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.276+0000 7f717959a640 1 -- 172.21.15.189:0/3219788938 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f71700058d0 con 0x7f717c079a50 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/3219788938 >> v1:172.21.15.189:6789/0 conn(0x7f717c079a50 legacy=0x7f717c10b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/3219788938 shutdown_connections 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/3219788938 >> 172.21.15.189:0/3219788938 conn(0x7f717c100d30 msgr2=0x7f717c103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/3219788938 shutdown_connections 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/3219788938 wait complete. 2024-09-06T15:02:44.964 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 Processor -- start 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- start start 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f717c19cab0 con 0x7f717c079a50 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f717a59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f717c079a50 0x7f717c19c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56202/0 (socket says 172.21.15.189:56202) 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f717a59c640 1 -- 172.21.15.189:0/2832572506 learned_addr learned my addr 172.21.15.189:0/2832572506 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869274085 0 0) 0x7f717c19cab0 con 0x7f717c079a50 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7164005570 con 0x7f717c079a50 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1195158523 0 0) 0x7f7164005570 con 0x7f717c079a50 2024-09-06T15:02:44.965 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f717c19cab0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7170001080 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3880502160 0 0) 0x7f717c19cab0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c19cca0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f717c1a0580 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f717c1a09a0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f7170001bb0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7170005fb0 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f7170006560 con 0x7f717c079a50 2024-09-06T15:02:44.966 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f7170007b50 con 0x7f717c079a50 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.280+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c0050b0 con 0x7f717c079a50 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.284+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f71700049b0 con 0x7f717c079a50 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.400+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 --> v1:172.21.15.189:6789/0 -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f715c0053a0 con 0x7f717c079a50 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.404+0000 7f716b7fe640 1 -- 172.21.15.189:0/2832572506 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 169+0+0 (unknown 2096464886 0 0) 0x7f7170005570 con 0x7f717c079a50 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.404+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 >> v1:172.21.15.189:6789/0 conn(0x7f717c079a50 legacy=0x7f717c19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.408+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 shutdown_connections 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.408+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 >> 172.21.15.189:0/2832572506 conn(0x7f717c100d30 msgr2=0x7f717c103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:44.967 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.408+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 shutdown_connections 2024-09-06T15:02:44.968 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:44.408+0000 7f7180bbf640 1 -- 172.21.15.189:0/2832572506 wait complete. 2024-09-06T15:02:44.968 INFO:teuthology.orchestra.run.smithi189.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-06T15:02:44.984 INFO:teuthology.orchestra.run.smithi189.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:02:44.985 INFO:teuthology.orchestra.run.smithi189.stdout:Creating mgr... 2024-09-06T15:02:44.985 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-06T15:02:44.985 INFO:teuthology.orchestra.run.smithi189.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-06T15:02:45.302 INFO:teuthology.orchestra.run.smithi189.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y 2024-09-06T15:02:45.302 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Failed to reset failed state of unit ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y.service: Unit ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y.service not loaded. 2024-09-06T15:02:45.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:45 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:02:45.524 INFO:teuthology.orchestra.run.smithi189.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968.target.wants/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service. 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:firewalld does not appear to be present 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:Not possible to enable service . firewalld.service is not available 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:firewalld does not appear to be present 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mgr to start... 2024-09-06T15:02:45.533 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mgr... 2024-09-06T15:02:45.665 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:45 smithi189 systemd[1]: Started Ceph mgr.y for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:02:45.665 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:45 smithi189 bash[22757]: audit 2024-09-06T15:02:44.408806+0000 mon.a (mon.0) 12 : audit [INF] from='client.? v1:172.21.15.189:0/2832572506' entity='client.admin' 2024-09-06T15:02:45.665 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:45 smithi189 bash[22757]: audit 2024-09-06T15:02:44.408806+0000 mon.a (mon.0) 12 : audit [INF] from='client.? v1:172.21.15.189:0/2832572506' entity='client.admin' 2024-09-06T15:02:45.665 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:45 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:02:47.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:47 smithi189 bash[22757]: audit 2024-09-06T15:02:47.390973+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/533761512' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:47.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:47 smithi189 bash[22757]: audit 2024-09-06T15:02:47.390973+0000 mon.a (mon.0) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/533761512' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:47.984 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsid": "de31ad16-6c60-11ef-bce4-c7b262605968", 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 0 2024-09-06T15:02:47.985 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "a" 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T15:02:47.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T15:02:47.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T15:02:37:979262+0000", 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T15:02:47.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T15:02:37.980546+0000", 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:47.990 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 Processor -- start 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- start start 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9dcc10cc60 con 0x7f9dcc079a50 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd1f62640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9dcc079a50 0x7f9dcc10b540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56232/0 (socket says 172.21.15.189:56232) 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd1f62640 1 -- 172.21.15.189:0/747809379 learned_addr learned my addr 172.21.15.189:0/747809379 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303242182 0 0) 0x7f9dcc10cc60 con 0x7f9dcc079a50 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db8003520 con 0x7f9dcc079a50 2024-09-06T15:02:47.991 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4282903139 0 0) 0x7f9db8003520 con 0x7f9dcc079a50 2024-09-06T15:02:47.995 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc10de40 con 0x7f9dcc079a50 2024-09-06T15:02:47.995 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9dbc001600 con 0x7f9dcc079a50 2024-09-06T15:02:47.995 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f9dbc001cf0 con 0x7f9dcc079a50 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd0f60640 1 -- 172.21.15.189:0/747809379 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9dbc0058d0 con 0x7f9dcc079a50 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- 172.21.15.189:0/747809379 >> v1:172.21.15.189:6789/0 conn(0x7f9dcc079a50 legacy=0x7f9dcc10b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- 172.21.15.189:0/747809379 shutdown_connections 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- 172.21.15.189:0/747809379 >> 172.21.15.189:0/747809379 conn(0x7f9dcc100d30 msgr2=0x7f9dcc103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- 172.21.15.189:0/747809379 shutdown_connections 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.259+0000 7f9dd41c6640 1 -- 172.21.15.189:0/747809379 wait complete. 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 Processor -- start 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 -- start start 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9dcc19cab0 con 0x7f9dcc079a50 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd1f62640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9dcc079a50 0x7f9dcc19c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56248/0 (socket says 172.21.15.189:56248) 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd1f62640 1 -- 172.21.15.189:0/533761512 learned_addr learned my addr 172.21.15.189:0/533761512 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408852769 0 0) 0x7f9dcc19cab0 con 0x7f9dcc079a50 2024-09-06T15:02:47.996 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db8005570 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2812985371 0 0) 0x7f9db8005570 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dcc19cab0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9dbc001080 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3015613142 0 0) 0x7f9dcc19cab0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc19cca0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc1a0580 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9dcc1a09a0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f9dbc001b30 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9dbc005ed0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f9dbc0064c0 con 0x7f9dcc079a50 2024-09-06T15:02:47.997 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f9dbc007ae0 con 0x7f9dcc079a50 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.263+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db00050b0 con 0x7f9dcc079a50 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.267+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f9dbc004b90 con 0x7f9dcc079a50 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.383+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9db00053a0 con 0x7f9dcc079a50 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dc2ffd640 1 -- 172.21.15.189:0/533761512 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (unknown 4201413639 0 400019936) 0x7f9dbc005570 con 0x7f9dcc079a50 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 >> v1:172.21.15.189:6789/0 conn(0x7f9dcc079a50 legacy=0x7f9dcc19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 shutdown_connections 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 >> 172.21.15.189:0/533761512 conn(0x7f9dcc100d30 msgr2=0x7f9dcc103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 shutdown_connections 2024-09-06T15:02:47.998 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:47.387+0000 7f9dd41c6640 1 -- 172.21.15.189:0/533761512 wait complete. 2024-09-06T15:02:47.999 INFO:teuthology.orchestra.run.smithi189.stdout:mgr not available, waiting (1/15)... 2024-09-06T15:02:51.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:51 smithi189 bash[22757]: audit 2024-09-06T15:02:51.186732+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? v1:172.21.15.189:0/391012968' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:51.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:51 smithi189 bash[22757]: audit 2024-09-06T15:02:51.186732+0000 mon.a (mon.0) 14 : audit [DBG] from='client.? v1:172.21.15.189:0/391012968' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:51.702 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:51.702 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:02:51.702 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsid": "de31ad16-6c60-11ef-bce4-c7b262605968", 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 0 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "a" 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-06T15:02:51.703 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T15:02:51.704 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T15:02:51.712 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T15:02:37:979262+0000", 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-06T15:02:51.713 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T15:02:37.980546+0000", 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T15:02:51.714 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7ea003640 1 Processor -- start 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7ea003640 1 -- start start 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7ea003640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb7e410a980 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e37fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb7e4106500 0x7fb7e4106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53834/0 (socket says 172.21.15.189:53834) 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e37fe640 1 -- 172.21.15.189:0/764943573 learned_addr learned my addr 172.21.15.189:0/764943573 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688345758 0 0) 0x7fb7e410a980 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7cc003520 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 842544267 0 0) 0x7fb7cc003520 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e410bb60 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb7d8001600 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fb7d8001cf0 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.055+0000 7fb7e27fc640 1 -- 172.21.15.189:0/764943573 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb7d80058d0 con 0x7fb7e4106500 2024-09-06T15:02:51.715 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/764943573 >> v1:172.21.15.189:6789/0 conn(0x7fb7e4106500 legacy=0x7fb7e4106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/764943573 shutdown_connections 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/764943573 >> 172.21.15.189:0/764943573 conn(0x7fb7e4101e10 msgr2=0x7fb7e4104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/764943573 shutdown_connections 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/764943573 wait complete. 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 Processor -- start 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- start start 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb7e407c900 con 0x7fb7e4106500 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e37fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb7e4106500 0x7fb7e407c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53846/0 (socket says 172.21.15.189:53846) 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e37fe640 1 -- 172.21.15.189:0/391012968 learned_addr learned my addr 172.21.15.189:0/391012968 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624853731 0 0) 0x7fb7e407c900 con 0x7fb7e4106500 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7cc005570 con 0x7fb7e4106500 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3480846061 0 0) 0x7fb7cc005570 con 0x7fb7e4106500 2024-09-06T15:02:51.716 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7e407c900 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb7d80047e0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 438018078 0 0) 0x7fb7e407c900 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e41a1120 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e41a0170 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7e41a06b0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fb7d8001b50 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb7d8005ed0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fb7d80064c0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7fb7d8007ab0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.059+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d00050b0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.063+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7fb7d80049b0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.179+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb7d00053a0 con 0x7fb7e4106500 2024-09-06T15:02:51.717 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7e0ff9640 1 -- 172.21.15.189:0/391012968 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (unknown 4201413639 0 521601483) 0x7fb7d8005570 con 0x7fb7e4106500 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 >> v1:172.21.15.189:6789/0 conn(0x7fb7e4106500 legacy=0x7fb7e407c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 shutdown_connections 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 >> 172.21.15.189:0/391012968 conn(0x7fb7e4101e10 msgr2=0x7fb7e4104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 shutdown_connections 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:51.183+0000 7fb7ea003640 1 -- 172.21.15.189:0/391012968 wait complete. 2024-09-06T15:02:51.718 INFO:teuthology.orchestra.run.smithi189.stdout:mgr not available, waiting (2/15)... 2024-09-06T15:02:52.851 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: debug 2024-09-06T15:02:52.379+0000 7efdbc793040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:02:52.851 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: debug 2024-09-06T15:02:52.379+0000 7efdbc793040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:02:52.851 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: from .module import Module 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: from .fs.volume import VolumeClient 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: debug 2024-09-06T15:02:52.379+0000 7efdbc793040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:02:52.852 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:52 smithi189 bash[23007]: debug 2024-09-06T15:02:52.379+0000 7efdbc793040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:02:53.601 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[23007]: debug 2024-09-06T15:02:53.131+0000 7efdbc793040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:02:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.157015+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.157015+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.164929+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00825171s) 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.164929+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00825171s) 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166259+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166259+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166379+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166379+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166474+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166474+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166579+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166579+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166696+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166696+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:02:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166789+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166789+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166885+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.166885+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.167411+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.167411+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.193085+0000 mon.a (mon.0) 25 : cluster [INF] Manager daemon y is now available 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: cluster 2024-09-06T15:02:53.193085+0000 mon.a (mon.0) 25 : cluster [INF] Manager daemon y is now available 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.203181+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.203181+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.205636+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:02:53.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:53 smithi189 bash[22757]: audit 2024-09-06T15:02:53.205636+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:02:54.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.208468+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.208468+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.220706+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.220706+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.225241+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: audit 2024-09-06T15:02:53.225241+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.14100 v1:172.21.15.189:0/499479012' entity='mgr.y' 2024-09-06T15:02:54.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: cluster 2024-09-06T15:02:54.172499+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e3: y(active, since 1.01582s) 2024-09-06T15:02:54.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:54 smithi189 bash[22757]: cluster 2024-09-06T15:02:54.172499+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e3: y(active, since 1.01582s) 2024-09-06T15:02:55.853 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsid": "de31ad16-6c60-11ef-bce4-c7b262605968", 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T15:02:55.854 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 0 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "a" 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T15:02:55.856 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T15:02:55.857 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T15:02:55.864 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.865 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T15:02:37:979262+0000", 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ], 2024-09-06T15:02:55.866 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T15:02:37.980546+0000", 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout }, 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72ba81e640 1 Processor -- start 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72ba81e640 1 -- start start 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72ba81e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f72b410cb70 con 0x7f72b41086f0 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72b3fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f72b41086f0 0x7f72b4108af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53914/0 (socket says 172.21.15.189:53914) 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72b3fff640 1 -- 172.21.15.189:0/80549049 learned_addr learned my addr 172.21.15.189:0/80549049 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:55.867 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180126988 0 0) 0x7f72b410cb70 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.879+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72a0003520 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848939511 0 0) 0x7f72a0003520 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b410dd50 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f729c001600 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f729c001cf0 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b2ffd640 1 -- 172.21.15.189:0/80549049 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f729c0058d0 con 0x7f72b41086f0 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/80549049 >> v1:172.21.15.189:6789/0 conn(0x7f72b41086f0 legacy=0x7f72b4108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/80549049 shutdown_connections 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/80549049 >> 172.21.15.189:0/80549049 conn(0x7f72b407bfb0 msgr2=0x7f72b407c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/80549049 shutdown_connections 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/80549049 wait complete. 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 Processor -- start 2024-09-06T15:02:55.868 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- start start 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f72b419ca60 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b3fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f72b41086f0 0x7f72b419c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53922/0 (socket says 172.21.15.189:53922) 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b3fff640 1 -- 172.21.15.189:0/3315014699 learned_addr learned my addr 172.21.15.189:0/3315014699 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043215737 0 0) 0x7f72b419ca60 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72a0005570 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 276678672 0 0) 0x7f72a0005570 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72b419ca60 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f729c0047e0 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3579113926 0 0) 0x7f72b419ca60 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b419cc50 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72b41a0530 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f72b41a0950 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f729c001b50 con 0x7f72b41086f0 2024-09-06T15:02:55.869 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f729c005ed0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72940050b0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.883+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 3) ==== 50009+0+0 (unknown 3805285511 0 0) 0x7f729c0123e0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.887+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f729c04cfc0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:54.891+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f729c018580 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.215+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mgrmap(e 4) ==== 50064+0+0 (unknown 783471040 0 0) 0x7f729c04bbe0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.299+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f72940053a0 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.299+0000 7f72b17fa640 1 -- 172.21.15.189:0/3315014699 <== mon.0 v1:172.21.15.189:6789/0 11 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (unknown 4201413639 0 3545142275) 0x7f729c01c890 con 0x7f72b41086f0 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 >> v1:172.21.15.189:6800/843694021 conn(0x7f72a003ec60 legacy=0x7f72a0041120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 >> v1:172.21.15.189:6789/0 conn(0x7f72b41086f0 legacy=0x7f72b419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 shutdown_connections 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 >> 172.21.15.189:0/3315014699 conn(0x7f72b407bfb0 msgr2=0x7f72b4107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 shutdown_connections 2024-09-06T15:02:55.870 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:55.303+0000 7f72ba81e640 1 -- 172.21.15.189:0/3315014699 wait complete. 2024-09-06T15:02:55.871 INFO:teuthology.orchestra.run.smithi189.stdout:mgr is available 2024-09-06T15:02:56.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:56 smithi189 bash[22757]: cluster 2024-09-06T15:02:55.221207+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-06T15:02:56.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:56 smithi189 bash[22757]: cluster 2024-09-06T15:02:55.221207+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-06T15:02:56.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:56 smithi189 bash[22757]: audit 2024-09-06T15:02:55.304431+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? v1:172.21.15.189:0/3315014699' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:56.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:56 smithi189 bash[22757]: audit 2024-09-06T15:02:55.304431+0000 mon.a (mon.0) 33 : audit [DBG] from='client.? v1:172.21.15.189:0/3315014699' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-06T15:02:57.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:57 smithi189 bash[22757]: audit 2024-09-06T15:02:57.129985+0000 mon.a (mon.0) 34 : audit [INF] from='client.? v1:172.21.15.189:0/355604428' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-06T15:02:57.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:57 smithi189 bash[22757]: audit 2024-09-06T15:02:57.129985+0000 mon.a (mon.0) 34 : audit [INF] from='client.? v1:172.21.15.189:0/355604428' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-06T15:02:57.608 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:57.608 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [global] 2024-09-06T15:02:57.608 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout fsid = de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.189:6789] 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 2024-09-06T15:02:57.609 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout [osd] 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.823+0000 7f05c4f23640 1 Processor -- start 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.823+0000 7f05c4f23640 1 -- start start 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.823+0000 7f05c4f23640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f05c007b2a0 con 0x7f05c007c530 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.823+0000 7f05be59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f05c007c530 0x7f05c007ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53934/0 (socket says 172.21.15.189:53934) 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.823+0000 7f05be59c640 1 -- 172.21.15.189:0/1863013509 learned_addr learned my addr 172.21.15.189:0/1863013509 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693994588 0 0) 0x7f05c007b2a0 con 0x7f05c007c530 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05ac003520 con 0x7f05c007c530 2024-09-06T15:02:57.610 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3604410057 0 0) 0x7f05ac003520 con 0x7f05c007c530 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c007b470 con 0x7f05c007c530 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f05b0001980 con 0x7f05c007c530 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f05b0001f70 con 0x7f05c007c530 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05bd59a640 1 -- 172.21.15.189:0/1863013509 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f05b0005c50 con 0x7f05c007c530 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/1863013509 >> v1:172.21.15.189:6789/0 conn(0x7f05c007c530 legacy=0x7f05c007ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/1863013509 shutdown_connections 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/1863013509 >> 172.21.15.189:0/1863013509 conn(0x7f05c0101e10 msgr2=0x7f05c0104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/1863013509 shutdown_connections 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/1863013509 wait complete. 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 Processor -- start 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- start start 2024-09-06T15:02:57.611 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f05c019cb40 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05be59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f05c007c530 0x7f05c019c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53948/0 (socket says 172.21.15.189:53948) 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05be59c640 1 -- 172.21.15.189:0/355604428 learned_addr learned my addr 172.21.15.189:0/355604428 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186575568 0 0) 0x7f05c019cb40 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05ac0055c0 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1881288894 0 0) 0x7f05ac0055c0 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c019cb40 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f05b0001400 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1338396742 0 0) 0x7f05c019cb40 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c019cd30 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05c01a0610 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05c01a0a30 con 0x7f05c007c530 2024-09-06T15:02:57.612 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f05b0001a40 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.827+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f05b00061c0 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.831+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 4) ==== 50064+0+0 (unknown 783471040 0 0) 0x7f05b0012700 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.831+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a00050b0 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.831+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f05b004d320 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:56.835+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f05b00188e0 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.123+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f05a0002420 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05b77fe640 1 -- 172.21.15.189:0/355604428 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+354 (unknown 1187553405 0 1460885159) 0x7f05b00181e0 con 0x7f05c007c530 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 >> v1:172.21.15.189:6800/843694021 conn(0x7f05ac03ec60 legacy=0x7f05ac041120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:57.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 >> v1:172.21.15.189:6789/0 conn(0x7f05c007c530 legacy=0x7f05c019c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:57.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 shutdown_connections 2024-09-06T15:02:57.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 >> 172.21.15.189:0/355604428 conn(0x7f05c0101e10 msgr2=0x7f05c010cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:57.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 shutdown_connections 2024-09-06T15:02:57.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:57.127+0000 7f05c4f23640 1 -- 172.21.15.189:0/355604428 wait complete. 2024-09-06T15:02:57.614 INFO:teuthology.orchestra.run.smithi189.stdout:Enabling cephadm module... 2024-09-06T15:02:59.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:59 smithi189 bash[22757]: audit 2024-09-06T15:02:59.040663+0000 mon.a (mon.0) 35 : audit [INF] from='client.? v1:172.21.15.189:0/1216910147' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-06T15:02:59.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:02:59 smithi189 bash[22757]: audit 2024-09-06T15:02:59.040663+0000 mon.a (mon.0) 35 : audit [INF] from='client.? v1:172.21.15.189:0/1216910147' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-06T15:02:59.352 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:59 smithi189 bash[23007]: ignoring --setuser ceph since I am not root 2024-09-06T15:02:59.352 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:02:59 smithi189 bash[23007]: ignoring --setgroup ceph since I am not root 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce1f3e8640 1 Processor -- start 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce1f3e8640 1 -- start start 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce1f3e8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fce18108650 con 0x7fce1807a470 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce1d184640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fce1807a470 0x7fce18106ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60022/0 (socket says 172.21.15.189:60022) 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce1d184640 1 -- 172.21.15.189:0/283421232 learned_addr learned my addr 172.21.15.189:0/283421232 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:59.613 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338299325 0 0) 0x7fce18108650 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce00003520 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173543128 0 0) 0x7fce00003520 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce18109830 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fce08001600 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fce08001bf0 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.639+0000 7fce17fff640 1 -- 172.21.15.189:0/283421232 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fce080058d0 con 0x7fce1807a470 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/283421232 >> v1:172.21.15.189:6789/0 conn(0x7fce1807a470 legacy=0x7fce18106ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/283421232 shutdown_connections 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/283421232 >> 172.21.15.189:0/283421232 conn(0x7fce18100d20 msgr2=0x7fce18103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/283421232 shutdown_connections 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/283421232 wait complete. 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 Processor -- start 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- start start 2024-09-06T15:02:59.614 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fce181a0f10 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1d184640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fce1807a470 0x7fce181a07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60034/0 (socket says 172.21.15.189:60034) 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1d184640 1 -- 172.21.15.189:0/1216910147 learned_addr learned my addr 172.21.15.189:0/1216910147 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583973390 0 0) 0x7fce181a0f10 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce000055c0 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3916857656 0 0) 0x7fce000055c0 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce181a0f10 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fce08001080 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 811325968 0 0) 0x7fce181a0f10 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce181a1100 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fce181a49e0 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fce181a4e00 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fce080016c0 con 0x7fce1807a470 2024-09-06T15:02:59.615 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fce08005e80 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 4) ==== 50064+0+0 (unknown 783471040 0 0) 0x7fce080123c0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.643+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce040050b0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.647+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7fce0804cff0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:58.651+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fce080185a0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.035+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fce040053a0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.087+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (unknown 2263024820 0 0) 0x7fce08017ea0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce167fc640 1 -- 172.21.15.189:0/1216910147 <== mon.0 v1:172.21.15.189:6789/0 11 ==== mgrmap(e 5) ==== 50075+0+0 (unknown 2034850001 0 0) 0x7fce0804bbc0 con 0x7fce1807a470 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 >> v1:172.21.15.189:6800/843694021 conn(0x7fce0003ec60 legacy=0x7fce00041120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 >> v1:172.21.15.189:6789/0 conn(0x7fce1807a470 legacy=0x7fce181a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 shutdown_connections 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 >> 172.21.15.189:0/1216910147 conn(0x7fce18100d20 msgr2=0x7fce18107fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 shutdown_connections 2024-09-06T15:02:59.616 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:02:59.091+0000 7fce1f3e8640 1 -- 172.21.15.189:0/1216910147 wait complete. 2024-09-06T15:03:00.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:00 smithi189 bash[22757]: audit 2024-09-06T15:02:59.092249+0000 mon.a (mon.0) 36 : audit [INF] from='client.? v1:172.21.15.189:0/1216910147' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-06T15:03:00.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:00 smithi189 bash[22757]: audit 2024-09-06T15:02:59.092249+0000 mon.a (mon.0) 36 : audit [INF] from='client.? v1:172.21.15.189:0/1216910147' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-06T15:03:00.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:00 smithi189 bash[22757]: cluster 2024-09-06T15:02:59.096963+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e5: y(active, since 5s) 2024-09-06T15:03:00.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:00 smithi189 bash[22757]: cluster 2024-09-06T15:02:59.096963+0000 mon.a (mon.0) 37 : cluster [DBG] mgrmap e5: y(active, since 5s) 2024-09-06T15:03:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:01 smithi189 bash[22757]: audit 2024-09-06T15:03:00.979124+0000 mon.a (mon.0) 38 : audit [DBG] from='client.? v1:172.21.15.189:0/2082161683' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-06T15:03:01.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:01 smithi189 bash[22757]: audit 2024-09-06T15:03:00.979124+0000 mon.a (mon.0) 38 : audit [DBG] from='client.? v1:172.21.15.189:0/2082161683' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 Processor -- start 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- start start 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9dec10a850 con 0x7f9dec07a3f0 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df257f640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9dec07a3f0 0x7f9dec109130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60052/0 (socket says 172.21.15.189:60052) 2024-09-06T15:03:01.529 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df257f640 1 -- 172.21.15.189:0/2837706685 learned_addr learned my addr 172.21.15.189:0/2837706685 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494644108 0 0) 0x7f9dec10a850 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd8003520 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 792864863 0 0) 0x7f9dd8003520 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec10ba30 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9ddc001600 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f9ddc001cf0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df157d640 1 -- 172.21.15.189:0/2837706685 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9ddc0058d0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- 172.21.15.189:0/2837706685 >> v1:172.21.15.189:6789/0 conn(0x7f9dec07a3f0 legacy=0x7f9dec109130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- 172.21.15.189:0/2837706685 shutdown_connections 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- 172.21.15.189:0/2837706685 >> 172.21.15.189:0/2837706685 conn(0x7f9dec100d20 msgr2=0x7f9dec103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- 172.21.15.189:0/2837706685 shutdown_connections 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- 172.21.15.189:0/2837706685 wait complete. 2024-09-06T15:03:01.530 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 Processor -- start 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.571+0000 7f9df47e3640 1 -- start start 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df47e3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9dec19ca50 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df257f640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9dec07a3f0 0x7f9dec19c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60056/0 (socket says 172.21.15.189:60056) 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df257f640 1 -- 172.21.15.189:0/2082161683 learned_addr learned my addr 172.21.15.189:0/2082161683 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614356296 0 0) 0x7f9dec19ca50 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd8005570 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3067089883 0 0) 0x7f9dd8005570 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dec19ca50 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9ddc0047e0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3696648177 0 0) 0x7f9dec19ca50 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec19cc40 con 0x7f9dec07a3f0 2024-09-06T15:03:01.531 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9dec1a0520 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9dec1a0940 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f9ddc001b10 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9ddc005ed0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 5) ==== 50075+0+0 (unknown 2034850001 0 0) 0x7f9ddc0124a0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd00050b0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f9ddc04d130 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.575+0000 7f9df1d7e640 1 -- 172.21.15.189:0/2082161683 >> v1:172.21.15.189:6800/843694021 conn(0x7f9dd803ec10 legacy=0x7f9dd80410d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.579+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f9ddc0186d0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.778+0000 7f9df1d7e640 1 -- 172.21.15.189:0/2082161683 >> v1:172.21.15.189:6800/843694021 conn(0x7f9dd803ec10 legacy=0x7f9dd80410d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9dd0005c70 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9de37fe640 1 -- 172.21.15.189:0/2082161683 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (unknown 3768197548 0 15966916) 0x7f9ddc017fd0 con 0x7f9dec07a3f0 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 >> v1:172.21.15.189:6800/843694021 conn(0x7f9dd803ec10 legacy=0x7f9dd80410d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-06T15:03:01.532 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 >> v1:172.21.15.189:6789/0 conn(0x7f9dec07a3f0 legacy=0x7f9dec19c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 shutdown_connections 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 >> 172.21.15.189:0/2082161683 conn(0x7f9dec100d20 msgr2=0x7f9dec104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 shutdown_connections 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:00.974+0000 7f9df47e3640 1 -- 172.21.15.189:0/2082161683 wait complete. 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for the mgr to restart... 2024-09-06T15:03:01.533 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mgr epoch 5... 2024-09-06T15:03:04.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: debug 2024-09-06T15:03:04.274+0000 7f6802136040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:03:04.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: debug 2024-09-06T15:03:04.274+0000 7f6802136040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:03:04.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:03:04.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: from .module import Module 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: from .fs.volume import VolumeClient 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: debug 2024-09-06T15:03:04.274+0000 7f6802136040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:03:04.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:04 smithi189 bash[23007]: debug 2024-09-06T15:03:04.274+0000 7f6802136040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:03:05.351 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[23007]: debug 2024-09-06T15:03:05.022+0000 7f6802136040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.048409+0000 mon.a (mon.0) 39 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.048409+0000 mon.a (mon.0) 39 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.048722+0000 mon.a (mon.0) 40 : cluster [INF] Activating manager daemon y 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.048722+0000 mon.a (mon.0) 40 : cluster [INF] Activating manager daemon y 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.055482+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.055482+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.055735+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00715788s) 2024-09-06T15:03:05.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.055735+0000 mon.a (mon.0) 42 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00715788s) 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.057089+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.057089+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.059224+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.059224+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060230+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060230+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060369+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060369+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060485+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: audit 2024-09-06T15:03:05.060485+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.084853+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2024-09-06T15:03:05.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:05 smithi189 bash[22757]: cluster 2024-09-06T15:03:05.084853+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2024-09-06T15:03:06.631 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:03:06.631 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-06T15:03:06.631 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-06T15:03:06.631 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:03:06.631 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 Processor -- start 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- start start 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04d810a980 con 0x7f04d8106500 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d6ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f04d8106500 0x7f04d8106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60062/0 (socket says 172.21.15.189:60062) 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d6ffd640 1 -- 172.21.15.189:0/25319672 learned_addr learned my addr 172.21.15.189:0/25319672 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373672152 0 0) 0x7f04d810a980 con 0x7f04d8106500 2024-09-06T15:03:06.632 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c4003520 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844960617 0 0) 0x7f04c4003520 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d810bb60 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f04c8001600 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f04c8001cf0 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04d67fc640 1 -- 172.21.15.189:0/25319672 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f04c80058d0 con 0x7f04d8106500 2024-09-06T15:03:06.633 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- 172.21.15.189:0/25319672 >> v1:172.21.15.189:6789/0 conn(0x7f04d8106500 legacy=0x7f04d8106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- 172.21.15.189:0/25319672 shutdown_connections 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- 172.21.15.189:0/25319672 >> 172.21.15.189:0/25319672 conn(0x7f04d8101dd0 msgr2=0x7f04d8104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- 172.21.15.189:0/25319672 shutdown_connections 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.542+0000 7f04dd700640 1 -- 172.21.15.189:0/25319672 wait complete. 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04dd700640 1 Processor -- start 2024-09-06T15:03:06.634 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04dd700640 1 -- start start 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04dd700640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f04d819a8b0 con 0x7f04d8106500 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d6ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f04d8106500 0x7f04d819a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60072/0 (socket says 172.21.15.189:60072) 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d6ffd640 1 -- 172.21.15.189:0/2879685497 learned_addr learned my addr 172.21.15.189:0/2879685497 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359736167 0 0) 0x7f04d819a8b0 con 0x7f04d8106500 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c4005570 con 0x7f04d8106500 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3467526774 0 0) 0x7f04c4005570 con 0x7f04d8106500 2024-09-06T15:03:06.635 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04d819a8b0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f04c80047e0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3300012370 0 0) 0x7f04d819a8b0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d819aaa0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04d819e380 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f04d819e7a0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f04c8001bd0 con 0x7f04d8106500 2024-09-06T15:03:06.636 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f04c8005f50 con 0x7f04d8106500 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 5) ==== 50075+0+0 (unknown 2034850001 0 0) 0x7f04c80124a0 con 0x7f04d8106500 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6800/843694021 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f04c40429b0 con 0x7f04c403ece0 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 3468434067 0 0) 0x7f04c804d320 con 0x7f04d8106500 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.546+0000 7f04cffff640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/843694021 conn(0x7f04c403ece0 legacy=0x7f04c40411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:02.750+0000 7f04cffff640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/843694021 conn(0x7f04c403ece0 legacy=0x7f04c40411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:03.154+0000 7f04cffff640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/843694021 conn(0x7f04c403ece0 legacy=0x7f04c40411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:03.958+0000 7f04cffff640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/843694021 conn(0x7f04c403ece0 legacy=0x7f04c40411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/843694021 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:05.046+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mgrmap(e 6) ==== 49928+0+0 (unknown 395253104 0 0) 0x7f04c804beb0 con 0x7f04d8106500 2024-09-06T15:03:06.637 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:05.046+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/843694021 conn(0x7f04c403ece0 legacy=0x7f04c40411a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.050+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mgrmap(e 7) ==== 50020+0+0 (unknown 4112414585 0 0) 0x7f04c8014270 con 0x7f04d8106500 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.050+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6800/1474022696 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f04c40429b0 con 0x7f04c4043690 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.054+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (unknown 0 0 1361822222) 0x7f04c40429b0 con 0x7f04c4043690 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 --> v1:172.21.15.189:6800/1474022696 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f04b80025a0 con 0x7f04c4043690 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04d4ff9640 1 -- 172.21.15.189:0/2879685497 <== mgr.14116 v1:172.21.15.189:6800/1474022696 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (unknown 0 0 96372106) 0x7f04b80025a0 con 0x7f04c4043690 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6800/1474022696 conn(0x7f04c4043690 legacy=0x7f04c4045a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:06.638 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 >> v1:172.21.15.189:6789/0 conn(0x7f04d8106500 legacy=0x7f04d819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 shutdown_connections 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 >> 172.21.15.189:0/2879685497 conn(0x7f04d8101dd0 msgr2=0x7f04d8104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 shutdown_connections 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:06.066+0000 7f04dd700640 1 -- 172.21.15.189:0/2879685497 wait complete. 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:mgr epoch 5 is available 2024-09-06T15:03:06.640 INFO:teuthology.orchestra.run.smithi189.stdout:Setting orchestrator backend to cephadm... 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.646242+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.646242+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.649211+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.649211+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: cephadm 2024-09-06T15:03:05.649770+0000 mgr.y (mgr.14116) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: cephadm 2024-09-06T15:03:05.649770+0000 mgr.y (mgr.14116) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.651774+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.651774+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.659348+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.659348+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:07.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.663590+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.663590+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.666261+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.666261+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.676457+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.676457+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.679175+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:05.679175+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:06.059744+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14120 v1:172.21.15.189:0/2879685497' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:06.059744+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14120 v1:172.21.15.189:0/2879685497' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: cluster 2024-09-06T15:03:06.060382+0000 mon.a (mon.0) 57 : cluster [DBG] mgrmap e7: y(active, since 1.01181s) 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: cluster 2024-09-06T15:03:06.060382+0000 mon.a (mon.0) 57 : cluster [DBG] mgrmap e7: y(active, since 1.01181s) 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:06.073695+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14120 v1:172.21.15.189:0/2879685497' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T15:03:07.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:06 smithi189 bash[22757]: audit 2024-09-06T15:03:06.073695+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14120 v1:172.21.15.189:0/2879685497' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T15:03:07.522 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: debug 2024-09-06T15:03:07.222+0000 7f6773bc2640 -1 log_channel(cephadm) log [ERR] : [06/Sep/2024:15:03:07] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:07.522 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: Traceback (most recent call last): 2024-09-06T15:03:07.522 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:07.522 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: self._run(expiration_interval) 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: s = self.context.wrap_socket( 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: return self.sslsocket_class._create( 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: self.do_handshake() 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:07.523 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: self._sslobj.do_handshake() 2024-09-06T15:03:07.524 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[23007]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:07.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.002142+0000 mgr.y (mgr.14116) 5 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Bus STARTING 2024-09-06T15:03:07.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.002142+0000 mgr.y (mgr.14116) 5 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Bus STARTING 2024-09-06T15:03:07.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.103822+0000 mgr.y (mgr.14116) 6 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:03:07.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.103822+0000 mgr.y (mgr.14116) 6 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:03:07.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: audit 2024-09-06T15:03:07.225535+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:07.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:07 smithi189 bash[22757]: audit 2024-09-06T15:03:07.225535+0000 mon.a (mon.0) 58 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:08.601 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde7953d640 1 Processor -- start 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde7953d640 1 -- start start 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde7953d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fde7410cb70 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde72ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fde741086f0 0x7fde74108af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60150/0 (socket says 172.21.15.189:60150) 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde72ffd640 1 -- 172.21.15.189:0/1784403349 learned_addr learned my addr 172.21.15.189:0/1784403349 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085222514 0 0) 0x7fde7410cb70 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.694+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde60003520 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2168519458 0 0) 0x7fde60003520 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7410dd50 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fde64001600 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fde64001cf0 con 0x7fde741086f0 2024-09-06T15:03:08.602 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde71ffb640 1 -- 172.21.15.189:0/1784403349 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fde640058d0 con 0x7fde741086f0 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/1784403349 >> v1:172.21.15.189:6789/0 conn(0x7fde741086f0 legacy=0x7fde74108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/1784403349 shutdown_connections 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/1784403349 >> 172.21.15.189:0/1784403349 conn(0x7fde7407bfb0 msgr2=0x7fde7407c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/1784403349 shutdown_connections 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/1784403349 wait complete. 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 Processor -- start 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- start start 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fde7419ca60 con 0x7fde741086f0 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde72ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fde741086f0 0x7fde7419c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60162/0 (socket says 172.21.15.189:60162) 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde72ffd640 1 -- 172.21.15.189:0/3616887080 learned_addr learned my addr 172.21.15.189:0/3616887080 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622778799 0 0) 0x7fde7419ca60 con 0x7fde741086f0 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde60005570 con 0x7fde741086f0 2024-09-06T15:03:08.603 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 751121946 0 0) 0x7fde60005570 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde7419ca60 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fde640047e0 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4185836459 0 0) 0x7fde7419ca60 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7419cc50 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde741a0530 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fde741a0950 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7fde64001b10 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.698+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fde64005ed0 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.702+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7fde64012420 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.702+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde540050b0 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.702+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7fde6404d080 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:07.706+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fde64018600 con 0x7fde741086f0 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.034+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fde54000bc0 con 0x7fde6003ec60 2024-09-06T15:03:08.604 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.046+0000 7fde6bfff640 1 -- 172.21.15.189:0/3616887080 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7fde54000bc0 con 0x7fde6003ec60 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.046+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 >> v1:172.21.15.189:6800/1474022696 conn(0x7fde6003ec60 legacy=0x7fde60041120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.046+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 >> v1:172.21.15.189:6789/0 conn(0x7fde741086f0 legacy=0x7fde7419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.046+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 shutdown_connections 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.046+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 >> 172.21.15.189:0/3616887080 conn(0x7fde7407bfb0 msgr2=0x7fde74107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.050+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 shutdown_connections 2024-09-06T15:03:08.605 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:08.050+0000 7fde7953d640 1 -- 172.21.15.189:0/3616887080 wait complete. 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.224543+0000 mgr.y (mgr.14116) 7 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.224543+0000 mgr.y (mgr.14116) 7 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.224718+0000 mgr.y (mgr.14116) 8 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Bus STARTED 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.224718+0000 mgr.y (mgr.14116) 8 : cephadm [INF] [06/Sep/2024:15:03:07] ENGINE Bus STARTED 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.227044+0000 mgr.y (mgr.14116) 9 : cephadm [ERR] [06/Sep/2024:15:03:07] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:09.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:09.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cephadm 2024-09-06T15:03:07.227044+0000 mgr.y (mgr.14116) 9 : cephadm [ERR] [06/Sep/2024:15:03:07] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:09.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cluster 2024-09-06T15:03:07.651901+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: cluster 2024-09-06T15:03:07.651901+0000 mon.a (mon.0) 59 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.038219+0000 mgr.y (mgr.14116) 10 : audit [DBG] from='client.14126 v1:172.21.15.189:0/3616887080' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.038219+0000 mgr.y (mgr.14116) 10 : audit [DBG] from='client.14126 v1:172.21.15.189:0/3616887080' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.046471+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:09.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.046471+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:09.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.057442+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:09.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:08 smithi189 bash[22757]: audit 2024-09-06T15:03:08.057442+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:10.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:10 smithi189 bash[22757]: audit 2024-09-06T15:03:10.026048+0000 mgr.y (mgr.14116) 11 : audit [DBG] from='client.14128 v1:172.21.15.189:0/3665129705' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:10.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:10 smithi189 bash[22757]: audit 2024-09-06T15:03:10.026048+0000 mgr.y (mgr.14116) 11 : audit [DBG] from='client.14128 v1:172.21.15.189:0/3665129705' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 Processor -- start 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- start start 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0e3010a940 con 0x7f0e301064c0 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e35172640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0e301064c0 0x7f0e301068c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50226/0 (socket says 172.21.15.189:50226) 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e35172640 1 -- 172.21.15.189:0/2756084040 learned_addr learned my addr 172.21.15.189:0/2756084040 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006760465 0 0) 0x7f0e3010a940 con 0x7f0e301064c0 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e18003520 con 0x7f0e301064c0 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3735776668 0 0) 0x7f0e18003520 con 0x7f0e301064c0 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3010bb20 con 0x7f0e301064c0 2024-09-06T15:03:10.586 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f0e20001980 con 0x7f0e301064c0 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f0e20002070 con 0x7f0e301064c0 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2ffff640 1 -- 172.21.15.189:0/2756084040 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f0e20005c50 con 0x7f0e301064c0 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/2756084040 >> v1:172.21.15.189:6789/0 conn(0x7f0e301064c0 legacy=0x7f0e301068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/2756084040 shutdown_connections 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/2756084040 >> 172.21.15.189:0/2756084040 conn(0x7f0e30101df0 msgr2=0x7f0e30104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/2756084040 shutdown_connections 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/2756084040 wait complete. 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 Processor -- start 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- start start 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0e3019ca20 con 0x7f0e301064c0 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e35172640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0e301064c0 0x7f0e3019c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50234/0 (socket says 172.21.15.189:50234) 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e35172640 1 -- 172.21.15.189:0/3665129705 learned_addr learned my addr 172.21.15.189:0/3665129705 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:10.587 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451762725 0 0) 0x7f0e3019ca20 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e18005570 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2543881609 0 0) 0x7f0e18005570 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e3019ca20 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f0e20004b60 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 608162960 0 0) 0x7f0e3019ca20 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3019cc10 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.722+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301a04f0 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e301a0910 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f0e20001ed0 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f0e20006250 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7f0e200127a0 con 0x7f0e301064c0 2024-09-06T15:03:10.588 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c0050b0 con 0x7f0e301064c0 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.726+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f0e2004d4f0 con 0x7f0e301064c0 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:09.730+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f0e20018990 con 0x7f0e301064c0 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.022+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0e1c000bc0 con 0x7f0e1803ed80 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.022+0000 7f0e2e7fc640 1 -- 172.21.15.189:0/3665129705 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (unknown 0 0 2070689548) 0x7f0e1c000bc0 con 0x7f0e1803ed80 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 >> v1:172.21.15.189:6800/1474022696 conn(0x7f0e1803ed80 legacy=0x7f0e18041240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 >> v1:172.21.15.189:6789/0 conn(0x7f0e301064c0 legacy=0x7f0e3019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.589 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 shutdown_connections 2024-09-06T15:03:10.590 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 >> 172.21.15.189:0/3665129705 conn(0x7f0e30101df0 msgr2=0x7f0e301021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:10.590 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 shutdown_connections 2024-09-06T15:03:10.590 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:10.026+0000 7f0e373d6640 1 -- 172.21.15.189:0/3665129705 wait complete. 2024-09-06T15:03:10.590 INFO:teuthology.orchestra.run.smithi189.stdout:Generating ssh key... 2024-09-06T15:03:12.482 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[22757]: audit 2024-09-06T15:03:11.900872+0000 mgr.y (mgr.14116) 12 : audit [DBG] from='client.14130 v1:172.21.15.189:0/2589036467' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:12.482 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[22757]: audit 2024-09-06T15:03:11.900872+0000 mgr.y (mgr.14116) 12 : audit [DBG] from='client.14130 v1:172.21.15.189:0/2589036467' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[22757]: cephadm 2024-09-06T15:03:11.901124+0000 mgr.y (mgr.14116) 13 : cephadm [INF] Generating ssh key... 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[22757]: cephadm 2024-09-06T15:03:11.901124+0000 mgr.y (mgr.14116) 13 : cephadm [INF] Generating ssh key... 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: Generating public/private rsa key pair. 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: Your identification has been saved in /tmp/tmpv_dbr6_g/key 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: Your public key has been saved in /tmp/tmpv_dbr6_g/key.pub 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: The key fingerprint is: 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: SHA256:6EzBUI3sx5t0lhgOUGDTMQhPqLBB23q60uMM9Sex14I ceph-de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: The key's randomart image is: 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: +---[RSA 3072]----+ 2024-09-06T15:03:12.483 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |...oBO=+ | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |o ++.+=.o | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |.= ...o+ o . | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |o . .o* + | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: | .... ooS= | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: | .o. B .o | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |.o E * . | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |.o+ + . | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: |.oo. | 2024-09-06T15:03:12.484 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:12 smithi189 bash[23007]: +----[SHA256]-----+ 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 Processor -- start 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 -- start start 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff4cc10a860 con 0x7ff4cc07a470 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d12e1640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff4cc07a470 0x7ff4cc1090b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50242/0 (socket says 172.21.15.189:50242) 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d12e1640 1 -- 172.21.15.189:0/1676448452 learned_addr learned my addr 172.21.15.189:0/1676448452 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436408075 0 0) 0x7ff4cc10a860 con 0x7ff4cc07a470 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b4003520 con 0x7ff4cc07a470 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2159238573 0 0) 0x7ff4b4003520 con 0x7ff4cc07a470 2024-09-06T15:03:12.875 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc10ba40 con 0x7ff4cc07a470 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff4c4001980 con 0x7ff4cc07a470 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7ff4c4001f70 con 0x7ff4cc07a470 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4cbfff640 1 -- 172.21.15.189:0/1676448452 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff4c4005c50 con 0x7ff4cc07a470 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 -- 172.21.15.189:0/1676448452 >> v1:172.21.15.189:6789/0 conn(0x7ff4cc07a470 legacy=0x7ff4cc1090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 -- 172.21.15.189:0/1676448452 shutdown_connections 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.590+0000 7ff4d3545640 1 -- 172.21.15.189:0/1676448452 >> 172.21.15.189:0/1676448452 conn(0x7ff4cc100d20 msgr2=0x7ff4cc103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- 172.21.15.189:0/1676448452 shutdown_connections 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- 172.21.15.189:0/1676448452 wait complete. 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 Processor -- start 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- start start 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff4cc106e60 con 0x7ff4cc07a470 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d12e1640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff4cc07a470 0x7ff4cc106700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50248/0 (socket says 172.21.15.189:50248) 2024-09-06T15:03:12.876 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d12e1640 1 -- 172.21.15.189:0/2589036467 learned_addr learned my addr 172.21.15.189:0/2589036467 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215210559 0 0) 0x7ff4cc106e60 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4b40055c0 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2390789971 0 0) 0x7ff4b40055c0 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4cc106e60 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff4c4001400 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1156011020 0 0) 0x7ff4cc106e60 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc1a11f0 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc1a0240 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff4cc1a0780 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7ff4c4001a40 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff4c40061c0 con 0x7ff4cc07a470 2024-09-06T15:03:12.877 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7ff4c4012710 con 0x7ff4cc07a470 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7ff4c404d490 con 0x7ff4cc07a470 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.594+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b80050b0 con 0x7ff4cc07a470 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.598+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ff4c4018940 con 0x7ff4cc07a470 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:11.898+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7ff4b8000bc0 con 0x7ff4b403ecb0 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.290+0000 7ff4ca7fc640 1 -- 172.21.15.189:0/2589036467 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7ff4b8000bc0 con 0x7ff4b403ecb0 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 >> v1:172.21.15.189:6800/1474022696 conn(0x7ff4b403ecb0 legacy=0x7ff4b4041170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 >> v1:172.21.15.189:6789/0 conn(0x7ff4cc07a470 legacy=0x7ff4cc106700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 shutdown_connections 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 >> 172.21.15.189:0/2589036467 conn(0x7ff4cc100d20 msgr2=0x7ff4cc107d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 shutdown_connections 2024-09-06T15:03:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:12.294+0000 7ff4d3545640 1 -- 172.21.15.189:0/2589036467 wait complete. 2024-09-06T15:03:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:13 smithi189 bash[22757]: audit 2024-09-06T15:03:12.285303+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:13 smithi189 bash[22757]: audit 2024-09-06T15:03:12.285303+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:13 smithi189 bash[22757]: audit 2024-09-06T15:03:12.289976+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:13 smithi189 bash[22757]: audit 2024-09-06T15:03:12.289976+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:14.748 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc5+v8o3dw4Yh6jxEuGOMFVsA5XdpjD9LwqUdTKpc7zEHfjvqv9gv/2Ya/wBQWvEA65u7J2OzHJJ69GaSBkTN1G+3enIUdkq9/IxhpAuswPv9ikB117cRuHmuaAnoCUbo1zbJRLmJAgDEbALKJyI1YmK3rjsViaVM/GFNjXqr9vwjJhJZhnkd3Cwrx9WYb+g7+ynGXb0tLJCWVKvnbxJ+K1erxUTBGQ33xAaBWMkTprtbof52QgBpwWTLWoDX5xVu4JMp6PZjtZvlkTvznPTczYkj5V5qi35yq40w48C9ZdpW84Ey+qenm5q08qIjBxUXV/i2sONQT4dxIMBV9ZSg8i/w/zm4DWPFvOQ0F+6bLTr2rMTkJqH6VQssJ4SOk6BGTnYlovEVj/KAZgYHx5JYeJ+U7f1sRrxc44beynh7FB2XweoKKIulkyypGIV2+sJ8pWSKyFprBrQUGq9spus3sHRp7WFHqlgDiDZ98tPb1684wcLrErDP9xVQfieA8VQc= ceph-de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:03:14.748 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 Processor -- start 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- start start 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f778807b2a0 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7787fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f778807c530 0x7f778807ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50260/0 (socket says 172.21.15.189:50260) 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7787fff640 1 -- 172.21.15.189:0/373701083 learned_addr learned my addr 172.21.15.189:0/373701083 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312077252 0 0) 0x7f778807b2a0 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7774003520 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 217170439 0 0) 0x7f7774003520 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778810a030 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7770001600 con 0x7f778807c530 2024-09-06T15:03:14.749 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f7770001bf0 con 0x7f778807c530 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7786ffd640 1 -- 172.21.15.189:0/373701083 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f77700058d0 con 0x7f778807c530 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- 172.21.15.189:0/373701083 >> v1:172.21.15.189:6789/0 conn(0x7f778807c530 legacy=0x7f778807ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- 172.21.15.189:0/373701083 shutdown_connections 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- 172.21.15.189:0/373701083 >> 172.21.15.189:0/373701083 conn(0x7f7788101e10 msgr2=0x7f7788104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- 172.21.15.189:0/373701083 shutdown_connections 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- 172.21.15.189:0/373701083 wait complete. 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 Processor -- start 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- start start 2024-09-06T15:03:14.750 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f778e598640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f77881a0f40 con 0x7f778807c530 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7787fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f778807c530 0x7f77881a07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50262/0 (socket says 172.21.15.189:50262) 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f7787fff640 1 -- 172.21.15.189:0/1007690670 learned_addr learned my addr 172.21.15.189:0/1007690670 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167298002 0 0) 0x7f77881a0f40 con 0x7f778807c530 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77740055c0 con 0x7f778807c530 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.902+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2765369739 0 0) 0x7f77740055c0 con 0x7f778807c530 2024-09-06T15:03:14.751 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77881a0f40 con 0x7f778807c530 2024-09-06T15:03:14.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7770001080 con 0x7f778807c530 2024-09-06T15:03:14.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 959304002 0 0) 0x7f77881a0f40 con 0x7f778807c530 2024-09-06T15:03:14.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77881a1130 con 0x7f778807c530 2024-09-06T15:03:14.752 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77881a4a10 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f77881a4e30 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f77700016c0 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7770005e50 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7f77700123c0 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77680050b0 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.906+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f777004d260 con 0x7f778807c530 2024-09-06T15:03:14.753 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:13.910+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f7770001b80 con 0x7f778807c530 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.206+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f7768000bc0 con 0x7f777403eca0 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f77857fa640 1 -- 172.21.15.189:0/1007690670 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (unknown 0 0 1356431617) 0x7f7768000bc0 con 0x7f777403eca0 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 >> v1:172.21.15.189:6800/1474022696 conn(0x7f777403eca0 legacy=0x7f7774041160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 >> v1:172.21.15.189:6789/0 conn(0x7f778807c530 legacy=0x7f77881a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 shutdown_connections 2024-09-06T15:03:14.754 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 >> 172.21.15.189:0/1007690670 conn(0x7f7788101e10 msgr2=0x7f77881087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:14.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 shutdown_connections 2024-09-06T15:03:14.755 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:14.210+0000 7f778e598640 1 -- 172.21.15.189:0/1007690670 wait complete. 2024-09-06T15:03:14.755 INFO:teuthology.orchestra.run.smithi189.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-06T15:03:14.756 INFO:teuthology.orchestra.run.smithi189.stdout:Adding key to root@localhost authorized_keys... 2024-09-06T15:03:14.756 INFO:teuthology.orchestra.run.smithi189.stdout:Adding host smithi189... 2024-09-06T15:03:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:15 smithi189 bash[22757]: audit 2024-09-06T15:03:14.211029+0000 mgr.y (mgr.14116) 14 : audit [DBG] from='client.14132 v1:172.21.15.189:0/1007690670' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:15 smithi189 bash[22757]: audit 2024-09-06T15:03:14.211029+0000 mgr.y (mgr.14116) 14 : audit [DBG] from='client.14132 v1:172.21.15.189:0/1007690670' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:16.457 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:16 smithi189 bash[22757]: audit 2024-09-06T15:03:16.137596+0000 mgr.y (mgr.14116) 15 : audit [DBG] from='client.14134 v1:172.21.15.189:0/3095424753' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "addr": "172.21.15.189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:16.457 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:16 smithi189 bash[22757]: audit 2024-09-06T15:03:16.137596+0000 mgr.y (mgr.14116) 15 : audit [DBG] from='client.14134 v1:172.21.15.189:0/3095424753' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "addr": "172.21.15.189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:17.263 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:17 smithi189 bash[22757]: cephadm 2024-09-06T15:03:17.142517+0000 mgr.y (mgr.14116) 16 : cephadm [INF] Deploying cephadm binary to smithi189 2024-09-06T15:03:17.263 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:17 smithi189 bash[22757]: cephadm 2024-09-06T15:03:17.142517+0000 mgr.y (mgr.14116) 16 : cephadm [INF] Deploying cephadm binary to smithi189 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout Added host 'smithi189' with addr '172.21.15.189' 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 Processor -- start 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- start start 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f863410cb70 con 0x7f86341086f0 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863259c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f86341086f0 0x7f8634108af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50268/0 (socket says 172.21.15.189:50268) 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863259c640 1 -- 172.21.15.189:0/2693703137 learned_addr learned my addr 172.21.15.189:0/2693703137 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169118016 0 0) 0x7f863410cb70 con 0x7f86341086f0 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f861c003520 con 0x7f86341086f0 2024-09-06T15:03:21.076 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346982544 0 0) 0x7f861c003520 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863410dd50 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8624001600 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f8624001bf0 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863159a640 1 -- 172.21.15.189:0/2693703137 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f86240058d0 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- 172.21.15.189:0/2693703137 >> v1:172.21.15.189:6789/0 conn(0x7f86341086f0 legacy=0x7f8634108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- 172.21.15.189:0/2693703137 shutdown_connections 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- 172.21.15.189:0/2693703137 >> 172.21.15.189:0/2693703137 conn(0x7f863407bf60 msgr2=0x7f863407c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- 172.21.15.189:0/2693703137 shutdown_connections 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- 172.21.15.189:0/2693703137 wait complete. 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 Processor -- start 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- start start 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f8638ce1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f863419cb30 con 0x7f86341086f0 2024-09-06T15:03:21.077 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863259c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f86341086f0 0x7f863419c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:50270/0 (socket says 172.21.15.189:50270) 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f863259c640 1 -- 172.21.15.189:0/3095424753 learned_addr learned my addr 172.21.15.189:0/3095424753 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678790454 0 0) 0x7f863419cb30 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.818+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f861c0055c0 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 271732987 0 0) 0x7f861c0055c0 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f863419cb30 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8624001080 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1429993404 0 0) 0x7f863419cb30 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863419cd20 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86341a0600 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f86341a0a20 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7f86240016c0 con 0x7f86341086f0 2024-09-06T15:03:21.078 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8624005eb0 con 0x7f86341086f0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7f86240124a0 con 0x7f86341086f0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86140050b0 con 0x7f86341086f0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.822+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f862404d1d0 con 0x7f86341086f0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:15.826+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f8624018720 con 0x7f86341086f0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:16.134+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "addr": "172.21.15.189", "target": ["mon-mgr", ""]}) -- 0x7f8614000bc0 con 0x7f861c03ebc0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.370+0000 7f86237fe640 1 -- 172.21.15.189:0/3095424753 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (unknown 0 0 323030420) 0x7f8614000bc0 con 0x7f861c03ebc0 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.370+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 >> v1:172.21.15.189:6800/1474022696 conn(0x7f861c03ebc0 legacy=0x7f861c041080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.370+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 >> v1:172.21.15.189:6789/0 conn(0x7f86341086f0 legacy=0x7f863419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.370+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 shutdown_connections 2024-09-06T15:03:21.079 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.370+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 >> 172.21.15.189:0/3095424753 conn(0x7f863407bf60 msgr2=0x7f8634107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:21.080 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.374+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 shutdown_connections 2024-09-06T15:03:21.080 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:20.374+0000 7f8638ce1640 1 -- 172.21.15.189:0/3095424753 wait complete. 2024-09-06T15:03:21.080 INFO:teuthology.orchestra.run.smithi189.stdout:Deploying unmanaged mon service... 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: audit 2024-09-06T15:03:20.371130+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: audit 2024-09-06T15:03:20.371130+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: cephadm 2024-09-06T15:03:20.371552+0000 mgr.y (mgr.14116) 17 : cephadm [INF] Added host smithi189 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: cephadm 2024-09-06T15:03:20.371552+0000 mgr.y (mgr.14116) 17 : cephadm [INF] Added host smithi189 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: audit 2024-09-06T15:03:20.371834+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:21 smithi189 bash[22757]: audit 2024-09-06T15:03:20.371834+0000 mon.a (mon.0) 65 : audit [DBG] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:23.969 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.877+0000 7ff89691b640 1 Processor -- start 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.877+0000 7ff89691b640 1 -- start start 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.877+0000 7ff89691b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff89010a860 con 0x7ff890079b60 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff890079b60 0x7ff890109140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39664/0 (socket says 172.21.15.189:39664) 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88ffff640 1 -- 172.21.15.189:0/3095726495 learned_addr learned my addr 172.21.15.189:0/3095726495 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2368848681 0 0) 0x7ff89010a860 con 0x7ff890079b60 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff878003520 con 0x7ff890079b60 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452586760 0 0) 0x7ff878003520 con 0x7ff890079b60 2024-09-06T15:03:23.970 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89010ba40 con 0x7ff890079b60 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff880001600 con 0x7ff890079b60 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7ff880001bf0 con 0x7ff890079b60 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88effd640 1 -- 172.21.15.189:0/3095726495 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff8800058d0 con 0x7ff890079b60 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/3095726495 >> v1:172.21.15.189:6789/0 conn(0x7ff890079b60 legacy=0x7ff890109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/3095726495 shutdown_connections 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/3095726495 >> 172.21.15.189:0/3095726495 conn(0x7ff890100d30 msgr2=0x7ff890103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/3095726495 shutdown_connections 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/3095726495 wait complete. 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 Processor -- start 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- start start 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff890106ef0 con 0x7ff890079b60 2024-09-06T15:03:23.971 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff890079b60 0x7ff890106790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39666/0 (socket says 172.21.15.189:39666) 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88ffff640 1 -- 172.21.15.189:0/222697079 learned_addr learned my addr 172.21.15.189:0/222697079 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180284175 0 0) 0x7ff890106ef0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8780055c0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1119004472 0 0) 0x7ff8780055c0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff890106ef0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff880001080 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4076072113 0 0) 0x7ff890106ef0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8901a1210 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8901a0260 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8901a07a0 con 0x7ff890079b60 2024-09-06T15:03:23.972 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 998+0+0 (unknown 1943348988 0 0) 0x7ff8800016c0 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.881+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ff880005eb0 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.885+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7ff8800124a0 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.885+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87c0050b0 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.885+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7ff88004d1d0 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:22.889+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ff880018720 con 0x7ff890079b60 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.221+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff87c000bc0 con 0x7ff87803ebc0 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.229+0000 7ff88d7fa640 1 -- 172.21.15.189:0/222697079 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 3265049985) 0x7ff87c000bc0 con 0x7ff87803ebc0 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 >> v1:172.21.15.189:6800/1474022696 conn(0x7ff87803ebc0 legacy=0x7ff878041080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:23.973 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 >> v1:172.21.15.189:6789/0 conn(0x7ff890079b60 legacy=0x7ff890106790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:23.975 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 shutdown_connections 2024-09-06T15:03:23.975 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 >> 172.21.15.189:0/222697079 conn(0x7ff890100d30 msgr2=0x7ff890107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:23.975 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 shutdown_connections 2024-09-06T15:03:23.975 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:23.233+0000 7ff89691b640 1 -- 172.21.15.189:0/222697079 wait complete. 2024-09-06T15:03:23.975 INFO:teuthology.orchestra.run.smithi189.stdout:Deploying unmanaged mgr service... 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.226584+0000 mgr.y (mgr.14116) 18 : audit [DBG] from='client.14136 v1:172.21.15.189:0/222697079' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.226584+0000 mgr.y (mgr.14116) 18 : audit [DBG] from='client.14136 v1:172.21.15.189:0/222697079' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: cephadm 2024-09-06T15:03:23.229446+0000 mgr.y (mgr.14116) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: cephadm 2024-09-06T15:03:23.229446+0000 mgr.y (mgr.14116) 19 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.232320+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:24.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.232320+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:24.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.869133+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:24.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:24 smithi189 bash[22757]: audit 2024-09-06T15:03:23.869133+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:25.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: audit 2024-09-06T15:03:24.463738+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:25.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: audit 2024-09-06T15:03:24.463738+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:25.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: cluster 2024-09-06T15:03:25.061903+0000 mgr.y (mgr.14116) 20 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:25.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: cluster 2024-09-06T15:03:25.061903+0000 mgr.y (mgr.14116) 20 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:25.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: cluster 2024-09-06T15:03:25.062169+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY) 2024-09-06T15:03:25.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:25 smithi189 bash[22757]: cluster 2024-09-06T15:03:25.062169+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY) 2024-09-06T15:03:26.050 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-06T15:03:26.050 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 Processor -- start 2024-09-06T15:03:26.050 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- start start 2024-09-06T15:03:26.050 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbf6010a980 con 0x7fbf60106500 2024-09-06T15:03:26.051 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf64b02640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbf60106500 0x7fbf60106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39674/0 (socket says 172.21.15.189:39674) 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf64b02640 1 -- 172.21.15.189:0/1076314504 learned_addr learned my addr 172.21.15.189:0/1076314504 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111846658 0 0) 0x7fbf6010a980 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf48003520 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960076117 0 0) 0x7fbf48003520 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6010bb60 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf50001600 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbf50001d10 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5f7fe640 1 -- 172.21.15.189:0/1076314504 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf500058d0 con 0x7fbf60106500 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- 172.21.15.189:0/1076314504 >> v1:172.21.15.189:6789/0 conn(0x7fbf60106500 legacy=0x7fbf60106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- 172.21.15.189:0/1076314504 shutdown_connections 2024-09-06T15:03:26.052 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- 172.21.15.189:0/1076314504 >> 172.21.15.189:0/1076314504 conn(0x7fbf60101e10 msgr2=0x7fbf60104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- 172.21.15.189:0/1076314504 shutdown_connections 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- 172.21.15.189:0/1076314504 wait complete. 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 Processor -- start 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- start start 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf66d66640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbf6007c900 con 0x7fbf60106500 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf64b02640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbf60106500 0x7fbf6007c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39678/0 (socket says 172.21.15.189:39678) 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf64b02640 1 -- 172.21.15.189:0/1670011016 learned_addr learned my addr 172.21.15.189:0/1670011016 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159318129 0 0) 0x7fbf6007c900 con 0x7fbf60106500 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.137+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf48005570 con 0x7fbf60106500 2024-09-06T15:03:26.055 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891507349 0 0) 0x7fbf48005570 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf6007c900 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf50001080 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3635092359 0 0) 0x7fbf6007c900 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf601a1140 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf601a0190 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf601a06d0 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbf50001820 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf50006060 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7fbf50012630 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7fbf5004d3f0 con 0x7fbf60106500 2024-09-06T15:03:26.056 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.141+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4c0050b0 con 0x7fbf60106500 2024-09-06T15:03:26.057 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.145+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fbf500188b0 con 0x7fbf60106500 2024-09-06T15:03:26.057 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.457+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 --> v1:172.21.15.189:6800/1474022696 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbf4c000bc0 con 0x7fbf4803ebf0 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.473+0000 7fbf5dffb640 1 -- 172.21.15.189:0/1670011016 <== mgr.14116 v1:172.21.15.189:6800/1474022696 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 325935098) 0x7fbf4c000bc0 con 0x7fbf4803ebf0 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.473+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 >> v1:172.21.15.189:6800/1474022696 conn(0x7fbf4803ebf0 legacy=0x7fbf480410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.473+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 >> v1:172.21.15.189:6789/0 conn(0x7fbf60106500 legacy=0x7fbf6007c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.477+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 shutdown_connections 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.477+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 >> 172.21.15.189:0/1670011016 conn(0x7fbf60101e10 msgr2=0x7fbf60104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.477+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 shutdown_connections 2024-09-06T15:03:26.058 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:25.477+0000 7fbf66d66640 1 -- 172.21.15.189:0/1670011016 wait complete. 2024-09-06T15:03:26.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: audit 2024-09-06T15:03:25.463387+0000 mgr.y (mgr.14116) 21 : audit [DBG] from='client.14138 v1:172.21.15.189:0/1670011016' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:26.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: audit 2024-09-06T15:03:25.463387+0000 mgr.y (mgr.14116) 21 : audit [DBG] from='client.14138 v1:172.21.15.189:0/1670011016' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:26.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: cephadm 2024-09-06T15:03:25.465583+0000 mgr.y (mgr.14116) 22 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-06T15:03:26.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: cephadm 2024-09-06T15:03:25.465583+0000 mgr.y (mgr.14116) 22 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-06T15:03:26.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: audit 2024-09-06T15:03:25.475421+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:26.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:26 smithi189 bash[22757]: audit 2024-09-06T15:03:25.475421+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:27.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:27 smithi189 bash[22757]: cluster 2024-09-06T15:03:27.062192+0000 mgr.y (mgr.14116) 23 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:27.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:27 smithi189 bash[22757]: cluster 2024-09-06T15:03:27.062192+0000 mgr.y (mgr.14116) 23 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:27.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:27 smithi189 bash[22757]: audit 2024-09-06T15:03:27.391884+0000 mon.a (mon.0) 71 : audit [INF] from='client.? v1:172.21.15.189:0/2283905186' entity='client.admin' 2024-09-06T15:03:27.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:27 smithi189 bash[22757]: audit 2024-09-06T15:03:27.391884+0000 mon.a (mon.0) 71 : audit [INF] from='client.? v1:172.21.15.189:0/2283905186' entity='client.admin' 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.073+0000 7f177e39b640 1 Processor -- start 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.073+0000 7f177e39b640 1 -- start start 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.073+0000 7f177e39b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f177810a980 con 0x7f1778106500 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1777fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1778106500 0x7f1778106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39684/0 (socket says 172.21.15.189:39684) 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1777fff640 1 -- 172.21.15.189:0/1327321592 learned_addr learned my addr 172.21.15.189:0/1327321592 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249006761 0 0) 0x7f177810a980 con 0x7f1778106500 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1764003520 con 0x7f1778106500 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2924224530 0 0) 0x7f1764003520 con 0x7f1778106500 2024-09-06T15:03:27.986 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177810bb60 con 0x7f1778106500 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1768001980 con 0x7f1778106500 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1768002090 con 0x7f1778106500 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1776ffd640 1 -- 172.21.15.189:0/1327321592 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1768005c50 con 0x7f1778106500 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/1327321592 >> v1:172.21.15.189:6789/0 conn(0x7f1778106500 legacy=0x7f1778106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/1327321592 shutdown_connections 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/1327321592 >> 172.21.15.189:0/1327321592 conn(0x7f1778101e10 msgr2=0x7f1778104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/1327321592 shutdown_connections 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/1327321592 wait complete. 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 Processor -- start 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- start start 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f177819a8a0 con 0x7f1778106500 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1777fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1778106500 0x7f177819a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39698/0 (socket says 172.21.15.189:39698) 2024-09-06T15:03:27.987 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f1777fff640 1 -- 172.21.15.189:0/2283905186 learned_addr learned my addr 172.21.15.189:0/2283905186 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155256236 0 0) 0x7f177819a8a0 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1764005570 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3682999057 0 0) 0x7f1764005570 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f177819a8a0 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1768001400 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 842571787 0 0) 0x7f177819a8a0 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177819aa90 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f177819e370 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f177819e790 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1768001ba0 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.077+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1768006370 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.081+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7f17680128c0 con 0x7f1778106500 2024-09-06T15:03:27.988 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.081+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17580050b0 con 0x7f1778106500 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.081+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f176804d5e0 con 0x7f1778106500 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.085+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f1768018ad0 con 0x7f1778106500 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.385+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 --> v1:172.21.15.189:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f17580053a0 con 0x7f1778106500 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.389+0000 7f17757fa640 1 -- 172.21.15.189:0/2283905186 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (unknown 2684808024 0 0) 0x7f17680183d0 con 0x7f1778106500 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.389+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 >> v1:172.21.15.189:6800/1474022696 conn(0x7f176403ece0 legacy=0x7f17640411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.389+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 >> v1:172.21.15.189:6789/0 conn(0x7f1778106500 legacy=0x7f177819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.393+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 shutdown_connections 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.393+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 >> 172.21.15.189:0/2283905186 conn(0x7f1778101e10 msgr2=0x7f1778190de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.393+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 shutdown_connections 2024-09-06T15:03:27.989 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:27.393+0000 7f177e39b640 1 -- 172.21.15.189:0/2283905186 wait complete. 2024-09-06T15:03:29.834 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 Processor -- start 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- start start 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbce810a8a0 con 0x7fbce8079b20 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbced100640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbce8079b20 0x7fbce8109180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:36992/0 (socket says 172.21.15.189:36992) 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbced100640 1 -- 172.21.15.189:0/32481761 learned_addr learned my addr 172.21.15.189:0/32481761 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881200201 0 0) 0x7fbce810a8a0 con 0x7fbce8079b20 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd4003520 con 0x7fbce8079b20 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2309632116 0 0) 0x7fbcd4003520 con 0x7fbce8079b20 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce810ba80 con 0x7fbce8079b20 2024-09-06T15:03:29.835 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbce4001600 con 0x7fbce8079b20 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbce4001d10 con 0x7fbce8079b20 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcdffff640 1 -- 172.21.15.189:0/32481761 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbce40058d0 con 0x7fbce8079b20 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- 172.21.15.189:0/32481761 >> v1:172.21.15.189:6789/0 conn(0x7fbce8079b20 legacy=0x7fbce8109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- 172.21.15.189:0/32481761 shutdown_connections 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- 172.21.15.189:0/32481761 >> 172.21.15.189:0/32481761 conn(0x7fbce8100d30 msgr2=0x7fbce8103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- 172.21.15.189:0/32481761 shutdown_connections 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- 172.21.15.189:0/32481761 wait complete. 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 Processor -- start 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- start start 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcef364640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbce819cb00 con 0x7fbce8079b20 2024-09-06T15:03:29.836 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbced100640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbce8079b20 0x7fbce819c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:36994/0 (socket says 172.21.15.189:36994) 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbced100640 1 -- 172.21.15.189:0/1603268269 learned_addr learned my addr 172.21.15.189:0/1603268269 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741676464 0 0) 0x7fbce819cb00 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.021+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd4005570 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1387371209 0 0) 0x7fbcd4005570 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbce819cb00 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbce4001080 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 141102358 0 0) 0x7fbce819cb00 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce819ccf0 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbce81a05d0 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbce81a0970 con 0x7fbce8079b20 2024-09-06T15:03:29.837 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbce40049d0 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbce4006340 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7fbce4012970 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc0050b0 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.025+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7fbce404d2b0 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.029+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fbce4018820 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.329+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 --> v1:172.21.15.189:6789/0 -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fbccc0053a0 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcde7fc640 1 -- 172.21.15.189:0/1603268269 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (unknown 1496729260 0 0) 0x7fbce4018120 con 0x7fbce8079b20 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 >> v1:172.21.15.189:6800/1474022696 conn(0x7fbcd403e8c0 legacy=0x7fbcd4040d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 >> v1:172.21.15.189:6789/0 conn(0x7fbce8079b20 legacy=0x7fbce819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 shutdown_connections 2024-09-06T15:03:29.838 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 >> 172.21.15.189:0/1603268269 conn(0x7fbce8100d30 msgr2=0x7fbce8104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:29.839 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 shutdown_connections 2024-09-06T15:03:29.839 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:29.333+0000 7fbcef364640 1 -- 172.21.15.189:0/1603268269 wait complete. 2024-09-06T15:03:29.839 INFO:teuthology.orchestra.run.smithi189.stdout:Enabling the dashboard module... 2024-09-06T15:03:30.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:30 smithi189 bash[22757]: cluster 2024-09-06T15:03:29.062448+0000 mgr.y (mgr.14116) 24 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:30.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:30 smithi189 bash[22757]: cluster 2024-09-06T15:03:29.062448+0000 mgr.y (mgr.14116) 24 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:30.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:30 smithi189 bash[22757]: audit 2024-09-06T15:03:29.334835+0000 mon.a (mon.0) 72 : audit [INF] from='client.? v1:172.21.15.189:0/1603268269' entity='client.admin' 2024-09-06T15:03:30.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:30 smithi189 bash[22757]: audit 2024-09-06T15:03:29.334835+0000 mon.a (mon.0) 72 : audit [INF] from='client.? v1:172.21.15.189:0/1603268269' entity='client.admin' 2024-09-06T15:03:32.328 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: cluster 2024-09-06T15:03:31.062869+0000 mgr.y (mgr.14116) 25 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:32.328 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: cluster 2024-09-06T15:03:31.062869+0000 mgr.y (mgr.14116) 25 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:32.328 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: audit 2024-09-06T15:03:31.313125+0000 mon.a (mon.0) 73 : audit [INF] from='client.? v1:172.21.15.189:0/3346531844' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-06T15:03:32.328 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: audit 2024-09-06T15:03:31.313125+0000 mon.a (mon.0) 73 : audit [INF] from='client.? v1:172.21.15.189:0/3346531844' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-06T15:03:32.329 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: audit 2024-09-06T15:03:31.514589+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:32.329 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[22757]: audit 2024-09-06T15:03:31.514589+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.14116 v1:172.21.15.189:0/553572420' entity='mgr.y' 2024-09-06T15:03:32.329 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[23007]: ignoring --setuser ceph since I am not root 2024-09-06T15:03:32.329 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:32 smithi189 bash[23007]: ignoring --setgroup ceph since I am not root 2024-09-06T15:03:32.741 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f0738310640 1 Processor -- start 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f0738310640 1 -- start start 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f0738310640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0730109870 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07360ac640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f07301053f0 0x7f07301057f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37008/0 (socket says 172.21.15.189:37008) 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07360ac640 1 -- 172.21.15.189:0/1573347819 learned_addr learned my addr 172.21.15.189:0/1573347819 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695787357 0 0) 0x7f0730109870 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f071c005730 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3482554584 0 0) 0x7f071c005730 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073010aa50 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f072c001600 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f072c001d10 con 0x7f07301053f0 2024-09-06T15:03:32.742 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.897+0000 7f07350aa640 1 -- 172.21.15.189:0/1573347819 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f072c0058d0 con 0x7f07301053f0 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/1573347819 >> v1:172.21.15.189:6789/0 conn(0x7f07301053f0 legacy=0x7f07301057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/1573347819 shutdown_connections 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/1573347819 >> 172.21.15.189:0/1573347819 conn(0x7f0730100d20 msgr2=0x7f0730103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/1573347819 shutdown_connections 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/1573347819 wait complete. 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 Processor -- start 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- start start 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f07301986a0 con 0x7f07301053f0 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07360ac640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f07301053f0 0x7f0730197f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37024/0 (socket says 172.21.15.189:37024) 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07360ac640 1 -- 172.21.15.189:0/3346531844 learned_addr learned my addr 172.21.15.189:0/3346531844 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333690443 0 0) 0x7f07301986a0 con 0x7f07301053f0 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f071c007780 con 0x7f07301053f0 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1989074073 0 0) 0x7f071c007780 con 0x7f07301053f0 2024-09-06T15:03:32.743 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07301986a0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f072c001080 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1925401169 0 0) 0x7f07301986a0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0730198890 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f073019c170 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f073019c590 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f072c001bb0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f072c005f50 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 8) ==== 50075+0+0 (unknown 1310705961 0 0) 0x7f072c0124a0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07140050b0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.901+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f072c04dfd0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:30.909+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f072c0186d0 con 0x7f07301053f0 2024-09-06T15:03:32.744 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:31.309+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f07140053a0 con 0x7f07301053f0 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.113+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (unknown 1498667528 0 0) 0x7f072c017fd0 con 0x7f07301053f0 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f07237fe640 1 -- 172.21.15.189:0/3346531844 <== mon.0 v1:172.21.15.189:6789/0 11 ==== mgrmap(e 9) ==== 50088+0+0 (unknown 3524652863 0 0) 0x7f072c014250 con 0x7f07301053f0 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 >> v1:172.21.15.189:6800/1474022696 conn(0x7f071c040e70 legacy=0x7f071c043330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 >> v1:172.21.15.189:6789/0 conn(0x7f07301053f0 legacy=0x7f0730197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 shutdown_connections 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 >> 172.21.15.189:0/3346531844 conn(0x7f0730100d20 msgr2=0x7f0730103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 shutdown_connections 2024-09-06T15:03:32.745 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:32.117+0000 7f0738310640 1 -- 172.21.15.189:0/3346531844 wait complete. 2024-09-06T15:03:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:33 smithi189 bash[22757]: audit 2024-09-06T15:03:32.117090+0000 mon.a (mon.0) 75 : audit [INF] from='client.? v1:172.21.15.189:0/3346531844' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-06T15:03:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:33 smithi189 bash[22757]: audit 2024-09-06T15:03:32.117090+0000 mon.a (mon.0) 75 : audit [INF] from='client.? v1:172.21.15.189:0/3346531844' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-06T15:03:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:33 smithi189 bash[22757]: cluster 2024-09-06T15:03:32.122696+0000 mon.a (mon.0) 76 : cluster [DBG] mgrmap e9: y(active, since 27s) 2024-09-06T15:03:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:33 smithi189 bash[22757]: cluster 2024-09-06T15:03:32.122696+0000 mon.a (mon.0) 76 : cluster [DBG] mgrmap e9: y(active, since 27s) 2024-09-06T15:03:34.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:34 smithi189 bash[22757]: audit 2024-09-06T15:03:34.257293+0000 mon.a (mon.0) 77 : audit [DBG] from='client.? v1:172.21.15.189:0/860895424' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-06T15:03:34.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:34 smithi189 bash[22757]: audit 2024-09-06T15:03:34.257293+0000 mon.a (mon.0) 77 : audit [DBG] from='client.? v1:172.21.15.189:0/860895424' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8c0597a640 1 Processor -- start 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8c0597a640 1 -- start start 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8c0597a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8c0010a950 con 0x7f8c001064d0 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfeffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f8c001064d0 0x7f8c001068d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37048/0 (socket says 172.21.15.189:37048) 2024-09-06T15:03:34.790 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfeffd640 1 -- 172.21.15.189:0/2197463756 learned_addr learned my addr 172.21.15.189:0/2197463756 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824987443 0 0) 0x7f8c0010a950 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be8003520 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2757067315 0 0) 0x7f8be8003520 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0010bb30 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8bf4001600 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f8bf4001d10 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.853+0000 7f8bfdffb640 1 -- 172.21.15.189:0/2197463756 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8bf40058d0 con 0x7f8c001064d0 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/2197463756 >> v1:172.21.15.189:6789/0 conn(0x7f8c001064d0 legacy=0x7f8c001068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/2197463756 shutdown_connections 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/2197463756 >> 172.21.15.189:0/2197463756 conn(0x7f8c00101de0 msgr2=0x7f8c00104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/2197463756 shutdown_connections 2024-09-06T15:03:34.791 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/2197463756 wait complete. 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 Processor -- start 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- start start 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8c0019a810 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8bfeffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f8c001064d0 0x7f8c0019a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37050/0 (socket says 172.21.15.189:37050) 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8bfeffd640 1 -- 172.21.15.189:0/860895424 learned_addr learned my addr 172.21.15.189:0/860895424 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638287206 0 0) 0x7f8c0019a810 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be8005570 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2435704413 0 0) 0x7f8be8005570 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c0019a810 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8bf4001080 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 242711788 0 0) 0x7f8c0019a810 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0019aa00 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0019e2e0 con 0x7f8c001064d0 2024-09-06T15:03:34.792 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c0019e700 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f8bf40055b0 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f8bf4006030 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 9) ==== 50088+0+0 (unknown 3524652863 0 0) 0x7f8bf40125a0 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bec0050b0 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f8bf404e120 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.857+0000 7f8bfe7fc640 1 -- 172.21.15.189:0/860895424 >> v1:172.21.15.189:6800/1474022696 conn(0x7f8be803ece0 legacy=0x7f8be80411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:33.861+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f8bf4018820 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.061+0000 7f8bfe7fc640 1 -- 172.21.15.189:0/860895424 >> v1:172.21.15.189:6800/1474022696 conn(0x7f8be803ece0 legacy=0x7f8be80411a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.253+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8bec005c70 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.253+0000 7f8c04978640 1 -- 172.21.15.189:0/860895424 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (unknown 2005831594 0 1748205903) 0x7f8bf4018120 con 0x7f8c001064d0 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 >> v1:172.21.15.189:6800/1474022696 conn(0x7f8be803ece0 legacy=0x7f8be80411a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 >> v1:172.21.15.189:6789/0 conn(0x7f8c001064d0 legacy=0x7f8c0019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:34.793 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 shutdown_connections 2024-09-06T15:03:34.794 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 >> 172.21.15.189:0/860895424 conn(0x7f8c00101de0 msgr2=0x7f8c00104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:34.794 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 shutdown_connections 2024-09-06T15:03:34.794 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:34.257+0000 7f8c0597a640 1 -- 172.21.15.189:0/860895424 wait complete. 2024-09-06T15:03:34.794 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for the mgr to restart... 2024-09-06T15:03:34.794 INFO:teuthology.orchestra.run.smithi189.stdout:Waiting for mgr epoch 9... 2024-09-06T15:03:37.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: debug 2024-09-06T15:03:37.317+0000 7f3ec7715040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:03:37.602 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: debug 2024-09-06T15:03:37.317+0000 7f3ec7715040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: from .module import Module 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: from .fs.volume import VolumeClient 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: debug 2024-09-06T15:03:37.317+0000 7f3ec7715040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:03:37.603 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:37 smithi189 bash[23007]: debug 2024-09-06T15:03:37.317+0000 7f3ec7715040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:03:38.352 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[23007]: debug 2024-09-06T15:03:38.065+0000 7f3ec7715040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:03:38.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.092512+0000 mon.a (mon.0) 78 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.092512+0000 mon.a (mon.0) 78 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.093248+0000 mon.a (mon.0) 79 : cluster [INF] Activating manager daemon y 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.093248+0000 mon.a (mon.0) 79 : cluster [INF] Activating manager daemon y 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.101123+0000 mon.a (mon.0) 80 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.101123+0000 mon.a (mon.0) 80 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.101388+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00850221s) 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.101388+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e10: y(active, starting, since 0.00850221s) 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.102887+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.102887+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.104094+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.104094+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:03:38.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105544+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105544+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105676+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105676+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105792+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: audit 2024-09-06T15:03:38.105792+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.128587+0000 mon.a (mon.0) 87 : cluster [INF] Manager daemon y is now available 2024-09-06T15:03:38.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:38 smithi189 bash[22757]: cluster 2024-09-06T15:03:38.128587+0000 mon.a (mon.0) 87 : cluster [INF] Manager daemon y is now available 2024-09-06T15:03:39.524 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.385984+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.385984+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.401798+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.401798+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.404345+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: audit 2024-09-06T15:03:38.404345+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: cluster 2024-09-06T15:03:39.101068+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e11: y(active, since 1.00819s) 2024-09-06T15:03:39.525 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[22757]: cluster 2024-09-06T15:03:39.101068+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e11: y(active, since 1.00819s) 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout { 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout } 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.825+0000 7f59ba2ac640 1 Processor -- start 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.825+0000 7f59ba2ac640 1 -- start start 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.825+0000 7f59ba2ac640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59b407b1f0 con 0x7f59b407c480 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.825+0000 7f59b3fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f59b407c480 0x7f59b407aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37052/0 (socket says 172.21.15.189:37052) 2024-09-06T15:03:39.733 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.825+0000 7f59b3fff640 1 -- 172.21.15.189:0/648474988 learned_addr learned my addr 172.21.15.189:0/648474988 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726667821 0 0) 0x7f59b407b1f0 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c003520 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3874775956 0 0) 0x7f599c003520 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b407b3c0 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f59ac001980 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f59ac002090 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b2ffd640 1 -- 172.21.15.189:0/648474988 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f59ac005c50 con 0x7f59b407c480 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/648474988 >> v1:172.21.15.189:6789/0 conn(0x7f59b407c480 legacy=0x7f59b407aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/648474988 shutdown_connections 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/648474988 >> 172.21.15.189:0/648474988 conn(0x7f59b4101dd0 msgr2=0x7f59b4104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/648474988 shutdown_connections 2024-09-06T15:03:39.734 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/648474988 wait complete. 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 Processor -- start 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- start start 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59b419ca80 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b3fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f59b407c480 0x7f59b419c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:37062/0 (socket says 172.21.15.189:37062) 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b3fff640 1 -- 172.21.15.189:0/950717659 learned_addr learned my addr 172.21.15.189:0/950717659 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033301666 0 0) 0x7f59b419ca80 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599c005570 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2104748476 0 0) 0x7f599c005570 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59b419ca80 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f59ac001400 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 629714183 0 0) 0x7f59b419ca80 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b419cc70 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59b41a0550 con 0x7f59b407c480 2024-09-06T15:03:39.735 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59b41a0970 con 0x7f59b407c480 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f59ac001ba0 con 0x7f59b407c480 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.829+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f59ac0063e0 con 0x7f59b407c480 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.833+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 9) ==== 50088+0+0 (unknown 3524652863 0 0) 0x7f59ac012930 con 0x7f59b407c480 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.833+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6800/1474022696 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f599c042960 con 0x7f599c03ec90 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.833+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 854+0+0 (unknown 1743615852 0 0) 0x7f59ac04d6c0 con 0x7f59b407c480 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:35.833+0000 7f59b37fe640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/1474022696 conn(0x7f599c03ec90 legacy=0x7f599c041150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:36.037+0000 7f59b37fe640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/1474022696 conn(0x7f599c03ec90 legacy=0x7f599c041150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:36.441+0000 7f59b37fe640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/1474022696 conn(0x7f599c03ec90 legacy=0x7f599c041150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:37.245+0000 7f59b37fe640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/1474022696 conn(0x7f599c03ec90 legacy=0x7f599c041150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/1474022696 2024-09-06T15:03:39.736 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:38.097+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mgrmap(e 10) ==== 49941+0+0 (unknown 126807498 0 0) 0x7f59ac04c1d0 con 0x7f59b407c480 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:38.097+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/1474022696 conn(0x7f599c03ec90 legacy=0x7f599c041150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.097+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mgrmap(e 11) ==== 50033+0+0 (unknown 837673774 0 0) 0x7f59ac014730 con 0x7f59b407c480 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.097+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6800/4002094494 -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f599c042960 con 0x7f599c043780 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.097+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (unknown 0 0 1361822222) 0x7f599c042960 con 0x7f599c043780 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 --> v1:172.21.15.189:6800/4002094494 -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f59a00025a0 con 0x7f599c043780 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59b17fa640 1 -- 172.21.15.189:0/950717659 <== mgr.14146 v1:172.21.15.189:6800/4002094494 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (unknown 0 0 3086460295) 0x7f59a00025a0 con 0x7f599c043780 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6800/4002094494 conn(0x7f599c043780 legacy=0x7f599c045b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 >> v1:172.21.15.189:6789/0 conn(0x7f59b407c480 legacy=0x7f59b419c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 shutdown_connections 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 >> 172.21.15.189:0/950717659 conn(0x7f59b4101dd0 msgr2=0x7f59b410cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 shutdown_connections 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:39.109+0000 7f59ba2ac640 1 -- 172.21.15.189:0/950717659 wait complete. 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:mgr epoch 9 is available 2024-09-06T15:03:39.737 INFO:teuthology.orchestra.run.smithi189.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: debug 2024-09-06T15:03:39.521+0000 7f3e3791e640 -1 log_channel(cephadm) log [ERR] : [06/Sep/2024:15:03:39] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: Traceback (most recent call last): 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: self._run(expiration_interval) 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:39.823 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: s = self.context.wrap_socket( 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: return self.sslsocket_class._create( 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: self.do_handshake() 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: self._sslobj.do_handshake() 2024-09-06T15:03:39.824 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:03:39 smithi189 bash[23007]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:40 smithi189 bash[22757]: audit 2024-09-06T15:03:39.099761+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 v1:172.21.15.189:0/950717659' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T15:03:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:40 smithi189 bash[22757]: audit 2024-09-06T15:03:39.099761+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 v1:172.21.15.189:0/950717659' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T15:03:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:40 smithi189 bash[22757]: audit 2024-09-06T15:03:39.112934+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14150 v1:172.21.15.189:0/950717659' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T15:03:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:40 smithi189 bash[22757]: audit 2024-09-06T15:03:39.112934+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14150 v1:172.21.15.189:0/950717659' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T15:03:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.301999+0000 mgr.y (mgr.14146) 4 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Bus STARTING 2024-09-06T15:03:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.301999+0000 mgr.y (mgr.14146) 4 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Bus STARTING 2024-09-06T15:03:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.403774+0000 mgr.y (mgr.14146) 5 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:03:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.403774+0000 mgr.y (mgr.14146) 5 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.524167+0000 mgr.y (mgr.14146) 6 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.524167+0000 mgr.y (mgr.14146) 6 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.524315+0000 mgr.y (mgr.14146) 7 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Bus STARTED 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.524315+0000 mgr.y (mgr.14146) 7 : cephadm [INF] [06/Sep/2024:15:03:39] ENGINE Bus STARTED 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.526368+0000 mgr.y (mgr.14146) 8 : cephadm [ERR] [06/Sep/2024:15:03:39] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:03:41.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cephadm 2024-09-06T15:03:39.526368+0000 mgr.y (mgr.14146) 8 : cephadm [ERR] [06/Sep/2024:15:03:39] ENGINE Error in HTTPServer.serve 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:03:41.606 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:03:41.607 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:03:41.608 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cluster 2024-09-06T15:03:40.160005+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-09-06T15:03:41.608 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:41 smithi189 bash[22757]: cluster 2024-09-06T15:03:40.160005+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE/DCCAuSgAwIBAgIUctBc9IMmgCjAOBELu+HLW2xEBf4wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkwNjE1MDM0MVoXDTM0\nMDkwNzE1MDM0MVowGDEWMBQGA1UEAwwNMTcyLjIxLjE1LjE4OTCCAiIwDQYJKoZI\nhvcNAQEBBQADggIPADCCAgoCggIBAMLC8IKJYA/xsKx9YmXe7Q+8lNohYdghUoNZ\nmdj1AFCsqxutMGveS5jd9rlNr4LoLokJyh26VRVw3xoxKiNpVB04IAM2jUYKRGUf\nnQULCu5tYBvS1zSvXv5BGVCb4MKUhuhlaIvn2u1e512G24++OCrZqtS52uNoytOI\nEEDRCsovcpRQqdXExiHrRZmP51C2SnAbycWol/QmTlmJcGdDv2TFbUsF/JSPiNDW\nEXhpyNieD429Kudg5ojDknVtwiQZ3bwz2kVsKewbT17mBHlIiDA4R/ZPISUDvEsc\nA/dAxQ0GZ5eX32mw5KCo5mxLVWjs0U/gbeJIT0XLdnt4Q1eNbanuZpOHFZbZcAK3\n+yWH+wT+Zj0REwzJe5IW2uNSpNVz4ql/EBe89EU2+oFoC4D0KlFOZx90BFwLmx77\noP0p2wWLzqf7c8B+CtaQNBU0IwJva4E+KjZV8zErKm/zgr8r5DZwstv0bnZcxVAH\n1FLY0YWqmgqVoLEsXQ/Pya03zKvYCcy8OvbEK8hMwUU5vxFB41pG/+fBOqn7osID\n5HLddEwBtJvmana/vAga47XJUaGqPDAyBk0TrCkBSn74ffvR/S4VsAuUI/lKB2Bm\n8ZjQTYrlZVXSYdGP6vMUen09/I3C5d9aEcDGRaIfQYy7IOQX5+2Im1yq1ik6naxn\n0h8x5GUbAgMBAAGjPzA9MC0GA1UdEQQmMCSCCXNtaXRoaTE4OYIRZGFzaGJvYXJk\nX3NlcnZlcnOHBKwVD70wDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQsFAAOCAgEA\na7IggocHq+VGhdAnJVVENqRfDN1wb7CPwlM9yiYtrVws3VtyIQekgwYByQ5w/VcX\nLIFybyVT2sSKQXqkYVuudfCGAd6KM7Y0jIpcy+/bDmGtiBHgbXz+FAhBi462XPoc\nhrszi15u5a4+iIFygCRMrRZZMPXRqa6s+hF8Sgc4OHx2QiM73b5glQijMT1fMQXB\nMnEZum51rJlCNJa7QpdsmQ7MeqIxeyjcFSiE6C3/JJZCDg6YHzOvpoVSh6lMKiEy\n/bigijWO/S2hdlXtgQtW/taR/K2YqRcz6nZ4PuXbdY5yME3Yoq8YfwGhKJG+Ic+B\nh4iH2u5Rqe0k6Ljm7KhKML6aBOHTooXJR8qKF2fGspVksFHraVD99uOHak5BOBzD\nlxcxqIYXKj9iUrt/+d3U6j27rHHqL4unFW5PRGvHu3A5mInwJFXpV6H8UHNGDVgX\nM8yZi7i+DqiLR0e8RSW37new/RaxXNBs6w5+HJzzyBl6gDEFLz6C4tkSnXkHnKQR\nT5GtnPrm6GlY2KGlG5t7+a2xYxgIosQJSszLF9aSZoy0hpLbrvEyUuxjmj+p+u/G\nVg1pAR/JvIPgW66fy0ipuki9XxZP1IY2hEKmlpilWHGfjMCcA29DCoFmFMOQllnY\ngNLSBYEuIrV6VwTIRidQX21a3Si3tuJHxuhd2wF+a64=\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAwsLwgolgD/GwrH1iZd7tD7yU2iFh2CFSg1mZ2PUAUKyrG60w\na95LmN32uU2vguguiQnKHbpVFXDfGjEqI2lUHTggAzaNRgpEZR+dBQsK7m1gG9LX\nNK9e/kEZUJvgwpSG6GVoi+fa7V7nXYbbj744Ktmq1Lna42jK04gQQNEKyi9ylFCp\n1cTGIetFmY/nULZKcBvJxaiX9CZOWYlwZ0O/ZMVtSwX8lI+I0NYReGnI2J4Pjb0q\n52DmiMOSdW3CJBndvDPaRWwp7BtPXuYEeUiIMDhH9k8hJQO8SxwD90DFDQZnl5ff\nabDkoKjmbEtVaOzRT+Bt4khPRct2e3hDV41tqe5mk4cVltlwArf7JYf7BP5mPRET\nDMl7khba41Kk1XPiqX8QF7z0RTb6gWgLgPQqUU5nH3QEXAubHvug/SnbBYvOp/tz\nwH4K1pA0FTQjAm9rgT4qNlXzMSsqb/OCvyvkNnCy2/RudlzFUAfUUtjRhaqaCpWg\nsSxdD8/JrTfMq9gJzLw69sQryEzBRTm/EUHjWkb/58E6qfuiwgPkct10TAG0m+Zq\ndr+8CBrjtclRoao8MDIGTROsKQFKfvh9+9H9LhWwC5Qj+UoHYGbxmNBNiuVlVdJh\n0Y/q8xR6fT38jcLl31oRwMZFoh9BjLsg5Bfn7YibXKrWKTqdrGfSHzHkZRsCAwEA\nAQKCAgBVp9SNJIvqFzrDcdWPxg5uqFqy4JGes3ENsZ93CrGbyYTrhCzSlA6daalz\n79Wr9h9ZR8PrdSKsblrAszS8JDvJKgDySNCzKBrSeqfdKvEg0Vu+gOkDE8nseob+\nq7+a9CWtGcR0G4Fuehm5SXFQ87DSL67xJdg9wb3KcIHtb8KWD24OCrfW+1bEXivb\nEK4EElgEnEQOOUqzJxG4UTjtQZ9wW1/o6fYfBE2Aw1UlpyidFE704Gh5IGXjalgE\na0RCClo5xnhNpfd+DrjGnNUE3kB/LJGBo2WJWO47/lNEL+k6BEIVKscoPZMfkYjd\nwfgLUHPx9Ft/dJvgr04pmUfMvremiy0O24C/rW3RQDXFdymuLo69AXtPQsK4beuS\nUTSuFARosJbDcbko2GEEDbh7C3TiiWYmPmRQPUstFb0vnlTZeQVqet91HsFyO4US\ng1nlczk32X3Bf034onUbFUXZ7rrd0YQgQUjfHBICZvnWmgf7qHA9oX8ph+PrhTQW\nrOHNi8bmGN/NJvqEbMDa+iVwi8MkIzTy9BudywF2LjHcraBKhBnaT4jjtnQoMI/y\n/6a2j2920/F9DqWRsmjdOxkBHqhmPgL+aafxTkTPXRrb7DG2TUujThGTDCLwiU14\nQcfIxCw1tYXw7UuVyKC1m6GQz6PK8nQt/L864ew4oi+so+620QKCAQEA6+7D1gm0\n7bEZsbP7z2i50eka3Tl514UQeofV9ZeQwMNVDJXrXU7hgYMuo7r+SVbScSe3B2MC\nzv3eZcv+6B7h96DTnxP1A1eFdK/b8TsnlA+pPvYqod8gARQaYltBy/9q7bF3kC4n\n4YFWEv6G2B7ecXwtayclNrb4scoazkiq0cC2QaNAJPYhxVT0caLdjvbFQkflX0Ml\npMtHraD4+p/Bnbd3mLnkeB7yU0V2UcyE+eAQukNbjfzOG1Uq661Q9aMEusJjSDrJ\nwNPrGvDlTdOLjYySLpYgT2W0/sEjhSbf5O7ZB2RC6dsIR93RCSFgC+dhwGBxeubw\nCCNDTc/fZn6hGQKCAQEA01O03RO0rOlZrlSKtfV7g+m8Nf8aFMDJmc1O2ddRW+PT\nDqRO62MJlJrNX53okZWv7L2GESSQCDU+O3vlj4/bKGZASjPdlBjst4N+vWidtqmB\naSzudsoynAQvFnPstixcDz/eZa4XSBr3BojQL+0SUOlxZYOQrOKW5gLOVDsJR4uE\nEIJllhvRk5/L/WyDjaiugY9/fbw0h+A3RglBz5n2wP7n13Zd5pcMco5Tpl14gfGA\n5cJ9j25/RPiFI9x8tsTJ0+xG5uCWpJCWSyOkVs7Zhj7q1DPZIkTqIckTPiQlHUrX\n36BDPTJg46+90uvfzYo8PA54ZAPwZo9iaPTSS1q6UwKCAQB+iisDC2W87nXHd68h\nCRxQ12OPL5qH21iBP4WkGUyL9rgQ7f+0pfARFJjZPBvSnfx0sEZcceA5wLOdiZII\nUTgFJn8aHQwWZMSxVvjyIzYRFW1C1aj79L4nle6oviVGEpH5NmvYKsk9C69stJMC\nK1xHJcD+bZpqBCzSvoEuDo9/vIqEHdjzegeW3P/WSvHmEbiu2fzN4Se5gUXKfEHN\nug2QV6yPf3RocMCrpN/W84iGtISEQkhCmUq6Ii3JBcYcWPjaahPx04YOJBs+8eEq\nosGAg9qLnf1qWDSBRnmUmssO8IP6kO3Km62PTgsliH8JI2qsUY3Lyz0GQFOC0nER\nee1RAoIBAQC1vRIY4j6KSbAnfWtBKtlLS7Lh2P5sBJQb4fXC4CqG1PoIaIO6aRSv\nKSYf6eQ9d7aw6RioG4KGnItlipqUiQnXx3/YkJwpJfpFpB9V8udXVJUHh22Y2TEG\n/Y4lSBK1ZJbTQoEXfs1k5FO22ef4n3AWB3zO6YN9Ouy86ILa616Cmdg8fnewzUHC\nLDW5Px4vsHZK08a3siiXBdtjLsjbKbSMq2tk39XHXfWFeyMzOsVNMw1ACrACruti\nvDt76L2UTM6po1Qib9j9s56dBgzp3sAxdGBtmB1PHGciIROcaGdGtrvKBMBum6m5\nhcTA5Ls2v4AnweYFVWHkQcFHM+y6g08jAoIBAAi5I5BJDE36alpcBtnldDtr5gBY\nGda22qEWtpjfsASh6lkB35a9wNnW/2RFRx/+GkeHnWYkeKSv1foeCn66uYimL5FJ\n/jBghctjiLnvYUcPg+8OATCGlLskEBefhNuYI+1JXmyw54Ta1UVQwmBa2N8+BY6P\neIESvLWs1MgLR2q5sEeaD/4WWygiYe1LvzX/VqYholzhA7Hz3BAPCNolrfNWq86p\nNqzcnmuDgpjQXMtiqbosGeYncrLnCurjo4LvnDBA+hyma7Si5Wrk/lQz0S1lwbTW\nh/Wdx4xqb0H08xwNlRftWhQkFnM2K8JuR6Zodbfd3LRH+EIkkMoOEJkZfEI=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 Processor -- start 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- start start 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd31010cb70 con 0x7fd3101086f0 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd3101086f0 0x7fd310108af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38870/0 (socket says 172.21.15.189:38870) 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30ffff640 1 -- 172.21.15.189:0/1106198271 learned_addr learned my addr 172.21.15.189:0/1106198271 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:42.257 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831880601 0 0) 0x7fd31010cb70 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2fc003520 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2714022644 0 0) 0x7fd2fc003520 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31010dd50 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd2f8001600 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fd2f8001c10 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd30effd640 1 -- 172.21.15.189:0/1106198271 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd2f80058d0 con 0x7fd3101086f0 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- 172.21.15.189:0/1106198271 >> v1:172.21.15.189:6789/0 conn(0x7fd3101086f0 legacy=0x7fd310108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- 172.21.15.189:0/1106198271 shutdown_connections 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- 172.21.15.189:0/1106198271 >> 172.21.15.189:0/1106198271 conn(0x7fd31007bf60 msgr2=0x7fd31007c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- 172.21.15.189:0/1106198271 shutdown_connections 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- 172.21.15.189:0/1106198271 wait complete. 2024-09-06T15:03:42.258 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 Processor -- start 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.817+0000 7fd316785640 1 -- start start 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd316785640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd31019cb50 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30ffff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd3101086f0 0x7fd31019c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38878/0 (socket says 172.21.15.189:38878) 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30ffff640 1 -- 172.21.15.189:0/2609060273 learned_addr learned my addr 172.21.15.189:0/2609060273 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459242990 0 0) 0x7fd31019cb50 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2fc0055c0 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2430772702 0 0) 0x7fd2fc0055c0 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd31019cb50 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd2f8005220 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1689422993 0 0) 0x7fd31019cb50 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31019cd40 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd3101a0620 con 0x7fd3101086f0 2024-09-06T15:03:42.259 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd3101a0a40 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fd2f8004bf0 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd2f8005e30 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f00050b0 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 12) ==== 50088+0+0 (unknown 226196211 0 0) 0x7fd2f80123a0 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.821+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fd2f804d1f0 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:40.825+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fd2f8018620 con 0x7fd3101086f0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.129+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}) -- 0x7fd2f0000bc0 con 0x7fd2fc03eda0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.709+0000 7fd30d7fa640 1 -- 172.21.15.189:0/2609060273 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5136 (unknown 0 0 1581076027) 0x7fd2f0000bc0 con 0x7fd2fc03eda0 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 >> v1:172.21.15.189:6800/4002094494 conn(0x7fd2fc03eda0 legacy=0x7fd2fc041260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 >> v1:172.21.15.189:6789/0 conn(0x7fd3101086f0 legacy=0x7fd31019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 shutdown_connections 2024-09-06T15:03:42.260 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 >> 172.21.15.189:0/2609060273 conn(0x7fd31007bf60 msgr2=0x7fd310107620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:42.261 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 shutdown_connections 2024-09-06T15:03:42.261 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:41.713+0000 7fd316785640 1 -- 172.21.15.189:0/2609060273 wait complete. 2024-09-06T15:03:42.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:42 smithi189 bash[22757]: audit 2024-09-06T15:03:41.132778+0000 mgr.y (mgr.14146) 9 : audit [DBG] from='client.14156 v1:172.21.15.189:0/2609060273' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:42.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:42 smithi189 bash[22757]: audit 2024-09-06T15:03:41.132778+0000 mgr.y (mgr.14146) 9 : audit [DBG] from='client.14156 v1:172.21.15.189:0/2609060273' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83bc650640 1 Processor -- start 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83bc650640 1 -- start start 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83bc650640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f83b410a8b0 con 0x7f83b407a390 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83ba3ec640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f83b407a390 0x7f83b4109190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38888/0 (socket says 172.21.15.189:38888) 2024-09-06T15:03:44.281 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83ba3ec640 1 -- 172.21.15.189:0/1174987481 learned_addr learned my addr 172.21.15.189:0/1174987481 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101701830 0 0) 0x7f83b410a8b0 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a0003520 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3373287533 0 0) 0x7f83a0003520 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b410ba90 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f83b0001600 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f83b0001d10 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.337+0000 7f83b93ea640 1 -- 172.21.15.189:0/1174987481 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f83b00058d0 con 0x7f83b407a390 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/1174987481 >> v1:172.21.15.189:6789/0 conn(0x7f83b407a390 legacy=0x7f83b4109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/1174987481 shutdown_connections 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/1174987481 >> 172.21.15.189:0/1174987481 conn(0x7f83b4100d20 msgr2=0x7f83b4103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/1174987481 shutdown_connections 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/1174987481 wait complete. 2024-09-06T15:03:44.282 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 Processor -- start 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- start start 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f83b419cb20 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83ba3ec640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f83b407a390 0x7f83b419c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38890/0 (socket says 172.21.15.189:38890) 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83ba3ec640 1 -- 172.21.15.189:0/3257481459 learned_addr learned my addr 172.21.15.189:0/3257481459 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054128233 0 0) 0x7f83b419cb20 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83a0005570 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1219744018 0 0) 0x7f83a0005570 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83b419cb20 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f83b00052b0 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 340857814 0 0) 0x7f83b419cb20 con 0x7f83b407a390 2024-09-06T15:03:44.283 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b419cd10 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f83b41a05f0 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f83b41a0a10 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f83b0001080 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f83b0005f40 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 12) ==== 50088+0+0 (unknown 226196211 0 0) 0x7f83b00124b0 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83980050b0 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.341+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7f83b004d340 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.349+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f83b0018690 con 0x7f83b407a390 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.685+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}) -- 0x7f8398002420 con 0x7f83a003ecd0 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.689+0000 7f83a77fe640 1 -- 172.21.15.189:0/3257481459 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 3881938646) 0x7f8398002420 con 0x7f83a003ecd0 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 >> v1:172.21.15.189:6800/4002094494 conn(0x7f83a003ecd0 legacy=0x7f83a0041190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:44.284 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 >> v1:172.21.15.189:6789/0 conn(0x7f83b407a390 legacy=0x7f83b419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:44.285 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 shutdown_connections 2024-09-06T15:03:44.285 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 >> 172.21.15.189:0/3257481459 conn(0x7f83b4100d20 msgr2=0x7f83b4104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:44.285 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 shutdown_connections 2024-09-06T15:03:44.285 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:43.693+0000 7f83bc650640 1 -- 172.21.15.189:0/3257481459 wait complete. 2024-09-06T15:03:45.090 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:44 smithi189 bash[22757]: audit 2024-09-06T15:03:43.688733+0000 mgr.y (mgr.14146) 10 : audit [DBG] from='client.14158 v1:172.21.15.189:0/3257481459' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:45.090 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:44 smithi189 bash[22757]: audit 2024-09-06T15:03:43.688733+0000 mgr.y (mgr.14146) 10 : audit [DBG] from='client.14158 v1:172.21.15.189:0/3257481459' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:45.091 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:44 smithi189 bash[22757]: audit 2024-09-06T15:03:43.693611+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:45.091 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:44 smithi189 bash[22757]: audit 2024-09-06T15:03:43.693611+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:46.196 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-06T15:03:46.196 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.233+0000 7fbf1d89b640 1 Processor -- start 2024-09-06T15:03:46.196 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.233+0000 7fbf1d89b640 1 -- start start 2024-09-06T15:03:46.196 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.233+0000 7fbf1d89b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbf1810a870 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.233+0000 7fbf16ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbf18079be0 0x7fbf181090c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38892/0 (socket says 172.21.15.189:38892) 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.233+0000 7fbf16ffd640 1 -- 172.21.15.189:0/584020096 learned_addr learned my addr 172.21.15.189:0/584020096 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456127247 0 0) 0x7fbf1810a870 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf00003520 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2768748359 0 0) 0x7fbf00003520 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1810ba50 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf10001980 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbf10001f90 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf15ffb640 1 -- 172.21.15.189:0/584020096 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf10005c50 con 0x7fbf18079be0 2024-09-06T15:03:46.197 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/584020096 >> v1:172.21.15.189:6789/0 conn(0x7fbf18079be0 legacy=0x7fbf181090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/584020096 shutdown_connections 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/584020096 >> 172.21.15.189:0/584020096 conn(0x7fbf18100d30 msgr2=0x7fbf18103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/584020096 shutdown_connections 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/584020096 wait complete. 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 Processor -- start 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- start start 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbf1819cb40 con 0x7fbf18079be0 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf16ffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbf18079be0 0x7fbf1819c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38906/0 (socket says 172.21.15.189:38906) 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf16ffd640 1 -- 172.21.15.189:0/489582745 learned_addr learned my addr 172.21.15.189:0/489582745 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659797187 0 0) 0x7fbf1819cb40 con 0x7fbf18079be0 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf000055c0 con 0x7fbf18079be0 2024-09-06T15:03:46.198 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2129308415 0 0) 0x7fbf000055c0 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf1819cb40 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf100055a0 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 357604307 0 0) 0x7fbf1819cb40 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1819cd30 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181a0610 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf181a0a30 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbf10004f70 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.237+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fbf100061b0 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.241+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 12) ==== 50088+0+0 (unknown 226196211 0 0) 0x7fbf10012720 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.241+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf040050b0 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.241+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fbf1004d520 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.245+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fbf100189a0 con 0x7fbf18079be0 2024-09-06T15:03:46.199 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.613+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}) -- 0x7fbf040053a0 con 0x7fbf0003ed50 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.617+0000 7fbf1c899640 1 -- 172.21.15.189:0/489582745 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (unknown 0 0 3070210822) 0x7fbf040053a0 con 0x7fbf0003ed50 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 >> v1:172.21.15.189:6800/4002094494 conn(0x7fbf0003ed50 legacy=0x7fbf00041210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 >> v1:172.21.15.189:6789/0 conn(0x7fbf18079be0 legacy=0x7fbf1819c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 shutdown_connections 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 >> 172.21.15.189:0/489582745 conn(0x7fbf18100d30 msgr2=0x7fbf18104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 shutdown_connections 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:45.621+0000 7fbf1d89b640 1 -- 172.21.15.189:0/489582745 wait complete. 2024-09-06T15:03:46.200 INFO:teuthology.orchestra.run.smithi189.stdout:Creating initial admin user... 2024-09-06T15:03:46.282 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:45 smithi189 bash[22757]: audit 2024-09-06T15:03:44.957280+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:46.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:45 smithi189 bash[22757]: audit 2024-09-06T15:03:44.957280+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:46.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:45 smithi189 bash[22757]: audit 2024-09-06T15:03:45.621803+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:46.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:45 smithi189 bash[22757]: audit 2024-09-06T15:03:45.621803+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:47 smithi189 bash[22757]: audit 2024-09-06T15:03:45.619278+0000 mgr.y (mgr.14146) 11 : audit [DBG] from='client.14160 v1:172.21.15.189:0/489582745' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:47 smithi189 bash[22757]: audit 2024-09-06T15:03:45.619278+0000 mgr.y (mgr.14146) 11 : audit [DBG] from='client.14160 v1:172.21.15.189:0/489582745' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:47 smithi189 bash[22757]: audit 2024-09-06T15:03:46.059492+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:47 smithi189 bash[22757]: audit 2024-09-06T15:03:46.059492+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:48.478 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$SZ0dA/dC1pJouT8/L3ww2Op6LLsyYWLej/CskyIGgt.h4V7vywGTW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725635027, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48bbd2640 1 Processor -- start 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48bbd2640 1 -- start start 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48bbd2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa48410cc40 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48996e640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa484079a70 0x7fa48410b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38916/0 (socket says 172.21.15.189:38916) 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48996e640 1 -- 172.21.15.189:0/1548228406 learned_addr learned my addr 172.21.15.189:0/1548228406 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754146771 0 0) 0x7fa48410cc40 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470003520 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060206446 0 0) 0x7fa470003520 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48410de20 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa480001600 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fa480001d10 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.333+0000 7fa48896c640 1 -- 172.21.15.189:0/1548228406 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa4800058d0 con 0x7fa484079a70 2024-09-06T15:03:48.479 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/1548228406 >> v1:172.21.15.189:6789/0 conn(0x7fa484079a70 legacy=0x7fa48410b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/1548228406 shutdown_connections 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/1548228406 >> 172.21.15.189:0/1548228406 conn(0x7fa484100d30 msgr2=0x7fa484103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/1548228406 shutdown_connections 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/1548228406 wait complete. 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 Processor -- start 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- start start 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa48419ca90 con 0x7fa484079a70 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48996e640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa484079a70 0x7fa48419c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38922/0 (socket says 172.21.15.189:38922) 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48996e640 1 -- 172.21.15.189:0/28992721 learned_addr learned my addr 172.21.15.189:0/28992721 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822951212 0 0) 0x7fa48419ca90 con 0x7fa484079a70 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470005570 con 0x7fa484079a70 2024-09-06T15:03:48.480 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4195201525 0 0) 0x7fa470005570 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa48419ca90 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa480001080 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3595779789 0 0) 0x7fa48419ca90 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48419cc80 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4841a0560 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4841a0980 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fa480001820 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa480006060 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 12) ==== 50088+0+0 (unknown 226196211 0 0) 0x7fa4800125b0 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.337+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680050b0 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.341+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fa48004d530 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.345+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fa480018830 con 0x7fa484079a70 2024-09-06T15:03:48.481 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.673+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fa468002420 con 0x7fa47003ec90 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa47affd640 1 -- 172.21.15.189:0/28992721 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (unknown 0 0 212204552) 0x7fa468002420 con 0x7fa47003ec90 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 >> v1:172.21.15.189:6800/4002094494 conn(0x7fa47003ec90 legacy=0x7fa470041150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 >> v1:172.21.15.189:6789/0 conn(0x7fa484079a70 legacy=0x7fa48419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 shutdown_connections 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 >> 172.21.15.189:0/28992721 conn(0x7fa484100d30 msgr2=0x7fa484103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 shutdown_connections 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:47.917+0000 7fa48bbd2640 1 -- 172.21.15.189:0/28992721 wait complete. 2024-09-06T15:03:48.482 INFO:teuthology.orchestra.run.smithi189.stdout:Fetching dashboard port number... 2024-09-06T15:03:49.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:48 smithi189 bash[22757]: audit 2024-09-06T15:03:47.676918+0000 mgr.y (mgr.14146) 12 : audit [DBG] from='client.14162 v1:172.21.15.189:0/28992721' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:48 smithi189 bash[22757]: audit 2024-09-06T15:03:47.676918+0000 mgr.y (mgr.14146) 12 : audit [DBG] from='client.14162 v1:172.21.15.189:0/28992721' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:48 smithi189 bash[22757]: audit 2024-09-06T15:03:47.918246+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:48 smithi189 bash[22757]: audit 2024-09-06T15:03:47.918246+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:50.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:50 smithi189 bash[22757]: audit 2024-09-06T15:03:49.980835+0000 mon.a (mon.0) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/349808520' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-06T15:03:50.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:50 smithi189 bash[22757]: audit 2024-09-06T15:03:49.980835+0000 mon.a (mon.0) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/349808520' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stdout 8443 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.677+0000 7f9b0e64e640 1 Processor -- start 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.677+0000 7f9b0e64e640 1 -- start start 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b0810cb70 con 0x7f9b081086f0 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b07fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9b081086f0 0x7f9b08108af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49362/0 (socket says 172.21.15.189:49362) 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b07fff640 1 -- 172.21.15.189:0/3145649890 learned_addr learned my addr 172.21.15.189:0/3145649890 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265888992 0 0) 0x7f9b0810cb70 con 0x7f9b081086f0 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af0003520 con 0x7f9b081086f0 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2582773186 0 0) 0x7f9af0003520 con 0x7f9b081086f0 2024-09-06T15:03:50.552 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0810dd50 con 0x7f9b081086f0 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9afc001600 con 0x7f9b081086f0 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f9afc001c10 con 0x7f9b081086f0 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b06ffd640 1 -- 172.21.15.189:0/3145649890 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9afc0058d0 con 0x7f9b081086f0 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/3145649890 >> v1:172.21.15.189:6789/0 conn(0x7f9b081086f0 legacy=0x7f9b08108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/3145649890 shutdown_connections 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/3145649890 >> 172.21.15.189:0/3145649890 conn(0x7f9b0807bf60 msgr2=0x7f9b0807c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/3145649890 shutdown_connections 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/3145649890 wait complete. 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 Processor -- start 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- start start 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b0819d020 con 0x7f9b0819c4a0 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b07fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9b0819c4a0 0x7f9b0819c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49374/0 (socket says 172.21.15.189:49374) 2024-09-06T15:03:50.553 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b07fff640 1 -- 172.21.15.189:0/349808520 learned_addr learned my addr 172.21.15.189:0/349808520 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626679763 0 0) 0x7f9b0819d020 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af00055c0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2508077089 0 0) 0x7f9af00055c0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b0819d020 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9afc001080 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 973805761 0 0) 0x7f9b0819d020 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b081a1720 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b081a0770 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b081a0d00 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f9afc005520 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.681+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f9afc005f40 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.685+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 12) ==== 50088+0+0 (unknown 226196211 0 0) 0x7f9afc012490 con 0x7f9b0819c4a0 2024-09-06T15:03:50.554 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.685+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af40050b0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.685+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7f9afc04d350 con 0x7f9b0819c4a0 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.689+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f9afc0185d0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.977+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9af40053a0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.977+0000 7f9b057fa640 1 -- 172.21.15.189:0/349808520 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (unknown 3713421687 0 83753974) 0x7f9afc017ed0 con 0x7f9b0819c4a0 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 >> v1:172.21.15.189:6800/4002094494 conn(0x7f9af003ed70 legacy=0x7f9af0041230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 >> v1:172.21.15.189:6789/0 conn(0x7f9b0819c4a0 legacy=0x7f9b0819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 shutdown_connections 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 >> 172.21.15.189:0/349808520 conn(0x7f9b0807bf60 msgr2=0x7f9b08107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 shutdown_connections 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:49.981+0000 7f9b0e64e640 1 -- 172.21.15.189:0/349808520 wait complete. 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:firewalld does not appear to be present 2024-09-06T15:03:50.555 INFO:teuthology.orchestra.run.smithi189.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout:Ceph Dashboard is now available at: 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout: URL: https://smithi189.front.sepia.ceph.com:8443/ 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout: User: admin 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout: Password: zpnza06sm1 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:50.556 INFO:teuthology.orchestra.run.smithi189.stdout:Saving cluster configuration to /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config directory 2024-09-06T15:03:52.180 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:52 smithi189 bash[22757]: cluster 2024-09-06T15:03:51.040007+0000 mon.a (mon.0) 99 : cluster [DBG] mgrmap e13: y(active, since 12s) 2024-09-06T15:03:52.180 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:52 smithi189 bash[22757]: cluster 2024-09-06T15:03:51.040007+0000 mon.a (mon.0) 99 : cluster [DBG] mgrmap e13: y(active, since 12s) 2024-09-06T15:03:53.274 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.105+0000 7f191a574640 1 Processor -- start 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.105+0000 7f191a574640 1 -- start start 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f191410a980 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1913fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1914106500 0x7f1914106900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49376/0 (socket says 172.21.15.189:49376) 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1913fff640 1 -- 172.21.15.189:0/4247469966 learned_addr learned my addr 172.21.15.189:0/4247469966 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738436184 0 0) 0x7f191410a980 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18fc003520 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4113194294 0 0) 0x7f18fc003520 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191410bb60 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1904001600 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 <== mon.0 v1:172.21.15.189:6789/0 4 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1904001d10 con 0x7f1914106500 2024-09-06T15:03:53.275 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1912ffd640 1 -- 172.21.15.189:0/4247469966 <== mon.0 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f19040058d0 con 0x7f1914106500 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/4247469966 >> v1:172.21.15.189:6789/0 conn(0x7f1914106500 legacy=0x7f1914106900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/4247469966 shutdown_connections 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/4247469966 >> 172.21.15.189:0/4247469966 conn(0x7f1914101e10 msgr2=0x7f1914104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/4247469966 shutdown_connections 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/4247469966 wait complete. 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 Processor -- start 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- start start 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f191419a880 con 0x7f1914106500 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1913fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1914106500 0x7f191419a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49384/0 (socket says 172.21.15.189:49384) 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f1913fff640 1 -- 172.21.15.189:0/1946352183 learned_addr learned my addr 172.21.15.189:0/1946352183 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171488701 0 0) 0x7f191419a880 con 0x7f1914106500 2024-09-06T15:03:53.276 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18fc005570 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237546684 0 0) 0x7f18fc005570 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f191419a880 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1904001080 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1736067003 0 0) 0x7f191419a880 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191419aa70 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f191419e350 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f191419e770 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1904001bb0 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.109+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f1904005f50 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.113+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7f19040124d0 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.113+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19000050b0 con 0x7f1914106500 2024-09-06T15:03:53.277 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.113+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7f190404d410 con 0x7f1914106500 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.117+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f1904018800 con 0x7f1914106500 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.597+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 --> v1:172.21.15.189:6789/0 -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f19000053a0 con 0x7f1914106500 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f19117fa640 1 -- 172.21.15.189:0/1946352183 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (unknown 38603050 0 0) 0x7f1904018100 con 0x7f1914106500 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 >> v1:172.21.15.189:6800/4002094494 conn(0x7f18fc03ed50 legacy=0x7f18fc041210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 >> v1:172.21.15.189:6789/0 conn(0x7f1914106500 legacy=0x7f191419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 shutdown_connections 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 >> 172.21.15.189:0/1946352183 conn(0x7f1914101e10 msgr2=0x7f1914104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 shutdown_connections 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:/usr/bin/ceph: stderr 2024-09-06T15:03:52.601+0000 7f191a574640 1 -- 172.21.15.189:0/1946352183 wait complete. 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.278 INFO:teuthology.orchestra.run.smithi189.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout:Or, if you are only running a single cluster on this host: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: ceph telemetry on 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout:For more information see: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:03:53.279 INFO:teuthology.orchestra.run.smithi189.stdout:Bootstrap complete. 2024-09-06T15:03:53.320 INFO:tasks.cephadm:Fetching config... 2024-09-06T15:03:53.321 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:03:53.321 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-06T15:03:53.326 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-06T15:03:53.326 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:03:53.326 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-06T15:03:53.373 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-06T15:03:53.373 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:03:53.373 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-06T15:03:53.426 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-06T15:03:53.427 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:03:53.427 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-06T15:03:53.473 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-06T15:03:53.474 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc5+v8o3dw4Yh6jxEuGOMFVsA5XdpjD9LwqUdTKpc7zEHfjvqv9gv/2Ya/wBQWvEA65u7J2OzHJJ69GaSBkTN1G+3enIUdkq9/IxhpAuswPv9ikB117cRuHmuaAnoCUbo1zbJRLmJAgDEbALKJyI1YmK3rjsViaVM/GFNjXqr9vwjJhJZhnkd3Cwrx9WYb+g7+ynGXb0tLJCWVKvnbxJ+K1erxUTBGQ33xAaBWMkTprtbof52QgBpwWTLWoDX5xVu4JMp6PZjtZvlkTvznPTczYkj5V5qi35yq40w48C9ZdpW84Ey+qenm5q08qIjBxUXV/i2sONQT4dxIMBV9ZSg8i/w/zm4DWPFvOQ0F+6bLTr2rMTkJqH6VQssJ4SOk6BGTnYlovEVj/KAZgYHx5JYeJ+U7f1sRrxc44beynh7FB2XweoKKIulkyypGIV2+sJ8pWSKyFprBrQUGq9spus3sHRp7WFHqlgDiDZ98tPb1684wcLrErDP9xVQfieA8VQc= ceph-de31ad16-6c60-11ef-bce4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-06T15:03:53.537 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc5+v8o3dw4Yh6jxEuGOMFVsA5XdpjD9LwqUdTKpc7zEHfjvqv9gv/2Ya/wBQWvEA65u7J2OzHJJ69GaSBkTN1G+3enIUdkq9/IxhpAuswPv9ikB117cRuHmuaAnoCUbo1zbJRLmJAgDEbALKJyI1YmK3rjsViaVM/GFNjXqr9vwjJhJZhnkd3Cwrx9WYb+g7+ynGXb0tLJCWVKvnbxJ+K1erxUTBGQ33xAaBWMkTprtbof52QgBpwWTLWoDX5xVu4JMp6PZjtZvlkTvznPTczYkj5V5qi35yq40w48C9ZdpW84Ey+qenm5q08qIjBxUXV/i2sONQT4dxIMBV9ZSg8i/w/zm4DWPFvOQ0F+6bLTr2rMTkJqH6VQssJ4SOk6BGTnYlovEVj/KAZgYHx5JYeJ+U7f1sRrxc44beynh7FB2XweoKKIulkyypGIV2+sJ8pWSKyFprBrQUGq9spus3sHRp7WFHqlgDiDZ98tPb1684wcLrErDP9xVQfieA8VQc= ceph-de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:03:53.546 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc5+v8o3dw4Yh6jxEuGOMFVsA5XdpjD9LwqUdTKpc7zEHfjvqv9gv/2Ya/wBQWvEA65u7J2OzHJJ69GaSBkTN1G+3enIUdkq9/IxhpAuswPv9ikB117cRuHmuaAnoCUbo1zbJRLmJAgDEbALKJyI1YmK3rjsViaVM/GFNjXqr9vwjJhJZhnkd3Cwrx9WYb+g7+ynGXb0tLJCWVKvnbxJ+K1erxUTBGQ33xAaBWMkTprtbof52QgBpwWTLWoDX5xVu4JMp6PZjtZvlkTvznPTczYkj5V5qi35yq40w48C9ZdpW84Ey+qenm5q08qIjBxUXV/i2sONQT4dxIMBV9ZSg8i/w/zm4DWPFvOQ0F+6bLTr2rMTkJqH6VQssJ4SOk6BGTnYlovEVj/KAZgYHx5JYeJ+U7f1sRrxc44beynh7FB2XweoKKIulkyypGIV2+sJ8pWSKyFprBrQUGq9spus3sHRp7WFHqlgDiDZ98tPb1684wcLrErDP9xVQfieA8VQc= ceph-de31ad16-6c60-11ef-bce4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-06T15:03:53.569 INFO:teuthology.orchestra.run.smithi190.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDc5+v8o3dw4Yh6jxEuGOMFVsA5XdpjD9LwqUdTKpc7zEHfjvqv9gv/2Ya/wBQWvEA65u7J2OzHJJ69GaSBkTN1G+3enIUdkq9/IxhpAuswPv9ikB117cRuHmuaAnoCUbo1zbJRLmJAgDEbALKJyI1YmK3rjsViaVM/GFNjXqr9vwjJhJZhnkd3Cwrx9WYb+g7+ynGXb0tLJCWVKvnbxJ+K1erxUTBGQ33xAaBWMkTprtbof52QgBpwWTLWoDX5xVu4JMp6PZjtZvlkTvznPTczYkj5V5qi35yq40w48C9ZdpW84Ey+qenm5q08qIjBxUXV/i2sONQT4dxIMBV9ZSg8i/w/zm4DWPFvOQ0F+6bLTr2rMTkJqH6VQssJ4SOk6BGTnYlovEVj/KAZgYHx5JYeJ+U7f1sRrxc44beynh7FB2XweoKKIulkyypGIV2+sJ8pWSKyFprBrQUGq9spus3sHRp7WFHqlgDiDZ98tPb1684wcLrErDP9xVQfieA8VQc= ceph-de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:03:53.579 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-06T15:03:53.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:53 smithi189 bash[22757]: audit 2024-09-06T15:03:52.603081+0000 mon.a (mon.0) 100 : audit [INF] from='client.? v1:172.21.15.189:0/1946352183' entity='client.admin' 2024-09-06T15:03:53.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:53 smithi189 bash[22757]: audit 2024-09-06T15:03:52.603081+0000 mon.a (mon.0) 100 : audit [INF] from='client.? v1:172.21.15.189:0/1946352183' entity='client.admin' 2024-09-06T15:03:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.075004+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.075004+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.079769+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.079769+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.081723+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.081723+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.087965+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.087965+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.118468+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.118468+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.126008+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:57 smithi189 bash[22757]: audit 2024-09-06T15:03:56.126008+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:03:58.468 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:03:59.458 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:59 smithi189 bash[22757]: cluster 2024-09-06T15:03:58.107264+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:59.458 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:03:59 smithi189 bash[22757]: cluster 2024-09-06T15:03:58.107264+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/3739860357 >> v1:172.21.15.189:6789/0 conn(0x7fa2901020a0 legacy=0x7fa2901024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/3739860357 shutdown_connections 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/3739860357 >> 172.21.15.189:0/3739860357 conn(0x7fa2900fd970 msgr2=0x7fa2900ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/3739860357 shutdown_connections 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/3739860357 wait complete. 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 Processor -- start 2024-09-06T15:03:59.618 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- start start 2024-09-06T15:03:59.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa2901978b0 con 0x7fa290196d30 2024-09-06T15:03:59.619 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa295821640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa290196d30 0x7fa290197150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:55494/0 (socket says 172.21.15.189:55494) 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa295821640 1 -- 172.21.15.189:0/1607608467 learned_addr learned my addr 172.21.15.189:0/1607608467 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962173529 0 0) 0x7fa2901978b0 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa27c003520 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3372094793 0 0) 0x7fa27c003520 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2901978b0 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa28c001960 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3838122983 0 0) 0x7fa2901978b0 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29019bfb0 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa29019b000 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa29019b590 con 0x7fa290196d30 2024-09-06T15:03:59.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fa28c001c10 con 0x7fa290196d30 2024-09-06T15:03:59.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fa28c004c60 con 0x7fa290196d30 2024-09-06T15:03:59.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.616+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2740050b0 con 0x7fa290196d30 2024-09-06T15:03:59.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.620+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fa28c004e20 con 0x7fa290196d30 2024-09-06T15:03:59.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.620+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fa28c04d3b0 con 0x7fa290196d30 2024-09-06T15:03:59.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.624+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fa28c018640 con 0x7fa290196d30 2024-09-06T15:03:59.788 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.784+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 --> v1:172.21.15.189:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa2740053a0 con 0x7fa290196d30 2024-09-06T15:03:59.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.788+0000 7fa286ffd640 1 -- 172.21.15.189:0/1607608467 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (unknown 3028693289 0 0) 0x7fa28c0011d0 con 0x7fa290196d30 2024-09-06T15:03:59.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 >> v1:172.21.15.189:6800/4002094494 conn(0x7fa27c03ebb0 legacy=0x7fa27c041070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:59.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 >> v1:172.21.15.189:6789/0 conn(0x7fa290196d30 legacy=0x7fa290197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:59.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 shutdown_connections 2024-09-06T15:03:59.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 >> 172.21.15.189:0/1607608467 conn(0x7fa2900fd970 msgr2=0x7fa2900ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:59.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 shutdown_connections 2024-09-06T15:03:59.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:03:59.792+0000 7fa297a85640 1 -- 172.21.15.189:0/1607608467 wait complete. 2024-09-06T15:04:00.379 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-06T15:04:00.379 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-06T15:04:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.793012+0000 mon.a (mon.0) 107 : audit [INF] from='client.? v1:172.21.15.189:0/1607608467' entity='client.admin' 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.793012+0000 mon.a (mon.0) 107 : audit [INF] from='client.? v1:172.21.15.189:0/1607608467' entity='client.admin' 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.805667+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.805667+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.813137+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: audit 2024-09-06T15:03:59.813137+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: cluster 2024-09-06T15:04:00.107752+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:01.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:00 smithi189 bash[22757]: cluster 2024-09-06T15:04:00.107752+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:03 smithi189 bash[22757]: cluster 2024-09-06T15:04:02.108240+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:03 smithi189 bash[22757]: cluster 2024-09-06T15:04:02.108240+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:05.103 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:04:05.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:05 smithi189 bash[22757]: cluster 2024-09-06T15:04:04.108680+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:05.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:05 smithi189 bash[22757]: cluster 2024-09-06T15:04:04.108680+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.220+0000 7f5ab73c5640 1 -- 172.21.15.189:0/1289676988 >> v1:172.21.15.189:6789/0 conn(0x7f5ab006b770 legacy=0x7f5ab0104c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.220+0000 7f5ab73c5640 1 -- 172.21.15.189:0/1289676988 shutdown_connections 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.220+0000 7f5ab73c5640 1 -- 172.21.15.189:0/1289676988 >> 172.21.15.189:0/1289676988 conn(0x7f5ab00fc880 msgr2=0x7f5ab00feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.220+0000 7f5ab73c5640 1 -- 172.21.15.189:0/1289676988 shutdown_connections 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.220+0000 7f5ab73c5640 1 -- 172.21.15.189:0/1289676988 wait complete. 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 Processor -- start 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 -- start start 2024-09-06T15:04:06.225 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5ab01972f0 con 0x7f5ab006b770 2024-09-06T15:04:06.226 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab5161640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5ab006b770 0x7f5ab0196b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:55508/0 (socket says 172.21.15.189:55508) 2024-09-06T15:04:06.226 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab5161640 1 -- 172.21.15.189:0/2415560975 learned_addr learned my addr 172.21.15.189:0/2415560975 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949431035 0 0) 0x7f5ab01972f0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a980054b0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3325123408 0 0) 0x7f5a980054b0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ab01972f0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f5aa8004760 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 826739152 0 0) 0x7f5ab01972f0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab01974e0 con 0x7f5ab006b770 2024-09-06T15:04:06.227 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab019adc0 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ab019b1e0 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5aa8001e50 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f5aa8005160 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9c0050b0 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7f5aa8005320 con 0x7f5ab006b770 2024-09-06T15:04:06.228 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.224+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7f5aa804d8d0 con 0x7f5ab006b770 2024-09-06T15:04:06.231 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.228+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f5aa8018ab0 con 0x7f5ab006b770 2024-09-06T15:04:06.400 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.396+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f5a9c000bc0 con 0x7f5a9803ec60 2024-09-06T15:04:06.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.404+0000 7f5aae7fc640 1 -- 172.21.15.189:0/2415560975 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (unknown 0 0 0) 0x7f5a9c000bc0 con 0x7f5a9803ec60 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5a9803ec60 legacy=0x7f5a98041120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 >> v1:172.21.15.189:6789/0 conn(0x7f5ab006b770 legacy=0x7f5ab0196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 shutdown_connections 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 >> 172.21.15.189:0/2415560975 conn(0x7f5ab00fc880 msgr2=0x7f5ab0105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 shutdown_connections 2024-09-06T15:04:06.410 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:06.408+0000 7f5ab73c5640 1 -- 172.21.15.189:0/2415560975 wait complete. 2024-09-06T15:04:07.039 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi190 2024-09-06T15:04:07.039 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:04:07.040 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.conf 2024-09-06T15:04:07.045 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:04:07.046 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:07.092 INFO:tasks.cephadm:Adding host smithi190 to orchestrator... 2024-09-06T15:04:07.092 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch host add smithi190 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: cluster 2024-09-06T15:04:06.109066+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: cluster 2024-09-06T15:04:06.109066+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.408181+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.408181+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.409643+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.409643+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.412159+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:07.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.412159+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.412980+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.412980+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.792508+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.792508+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.795584+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.795584+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.798872+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:07.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:07 smithi189 bash[22757]: audit 2024-09-06T15:04:06.798872+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: audit 2024-09-06T15:04:06.402767+0000 mgr.y (mgr.14146) 18 : audit [DBG] from='client.14170 v1:172.21.15.189:0/2415560975' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: audit 2024-09-06T15:04:06.402767+0000 mgr.y (mgr.14146) 18 : audit [DBG] from='client.14170 v1:172.21.15.189:0/2415560975' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.413983+0000 mgr.y (mgr.14146) 19 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.413983+0000 mgr.y (mgr.14146) 19 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.503063+0000 mgr.y (mgr.14146) 20 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.503063+0000 mgr.y (mgr.14146) 20 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.586695+0000 mgr.y (mgr.14146) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.586695+0000 mgr.y (mgr.14146) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.673470+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:08 smithi189 bash[22757]: cephadm 2024-09-06T15:04:06.673470+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:09.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:09 smithi189 bash[22757]: cluster 2024-09-06T15:04:08.109496+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:09.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:09 smithi189 bash[22757]: cluster 2024-09-06T15:04:08.109496+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:11.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:11 smithi189 bash[22757]: cluster 2024-09-06T15:04:10.109977+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:11.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:11 smithi189 bash[22757]: cluster 2024-09-06T15:04:10.109977+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:11.819 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:04:12.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/140669898 >> v1:172.21.15.189:6789/0 conn(0x7fb558103330 legacy=0x7fb558103710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/140669898 shutdown_connections 2024-09-06T15:04:12.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/140669898 >> 172.21.15.189:0/140669898 conn(0x7fb5580fcd70 msgr2=0x7fb5580ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.959 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/140669898 shutdown_connections 2024-09-06T15:04:12.959 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/140669898 wait complete. 2024-09-06T15:04:12.959 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 Processor -- start 2024-09-06T15:04:12.959 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- start start 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb5581976b0 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb557fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb558103330 0x7fb558196fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:53712/0 (socket says 172.21.15.189:53712) 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb557fff640 1 -- 172.21.15.189:0/2187292722 learned_addr learned my addr 172.21.15.189:0/2187292722 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747297873 0 0) 0x7fb5581976b0 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb540005500 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4278105096 0 0) 0x7fb540005500 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5581976b0 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb5480013b0 con 0x7fb558103330 2024-09-06T15:04:12.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 692946246 0 0) 0x7fb5581976b0 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb558197880 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb558197b70 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb55819fce0 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fb5480019a0 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.956+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb548004e10 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.960+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb544005080 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.960+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fb548005110 con 0x7fb558103330 2024-09-06T15:04:12.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.960+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fb54804d080 con 0x7fb558103330 2024-09-06T15:04:12.965 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:12.964+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fb5480184c0 con 0x7fb558103330 2024-09-06T15:04:13.130 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:13.128+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}) -- 0x7fb544000b90 con 0x7fb54003ebe0 2024-09-06T15:04:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:13 smithi189 bash[22757]: cluster 2024-09-06T15:04:12.110481+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:13 smithi189 bash[22757]: cluster 2024-09-06T15:04:12.110481+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:14.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:14 smithi189 bash[22757]: audit 2024-09-06T15:04:13.132875+0000 mgr.y (mgr.14146) 26 : audit [DBG] from='client.14172 v1:172.21.15.189:0/2187292722' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:14.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:14 smithi189 bash[22757]: audit 2024-09-06T15:04:13.132875+0000 mgr.y (mgr.14146) 26 : audit [DBG] from='client.14172 v1:172.21.15.189:0/2187292722' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:15 smithi189 bash[22757]: cluster 2024-09-06T15:04:14.110941+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:15 smithi189 bash[22757]: cluster 2024-09-06T15:04:14.110941+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:15.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:15 smithi189 bash[22757]: cephadm 2024-09-06T15:04:14.146350+0000 mgr.y (mgr.14146) 28 : cephadm [INF] Deploying cephadm binary to smithi190 2024-09-06T15:04:15.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:15 smithi189 bash[22757]: cephadm 2024-09-06T15:04:14.146350+0000 mgr.y (mgr.14146) 28 : cephadm [INF] Deploying cephadm binary to smithi190 2024-09-06T15:04:17.391 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.388+0000 7fb5557fa640 1 -- 172.21.15.189:0/2187292722 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (unknown 0 0 372217924) 0x7fb544000b90 con 0x7fb54003ebe0 2024-09-06T15:04:17.391 INFO:teuthology.orchestra.run.smithi189.stdout:Added host 'smithi190' with addr '172.21.15.190' 2024-09-06T15:04:17.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 >> v1:172.21.15.189:6800/4002094494 conn(0x7fb54003ebe0 legacy=0x7fb5400410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:17.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 >> v1:172.21.15.189:6789/0 conn(0x7fb558103330 legacy=0x7fb558196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:17.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 shutdown_connections 2024-09-06T15:04:17.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 >> 172.21.15.189:0/2187292722 conn(0x7fb5580fcd70 msgr2=0x7fb55810a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:17.394 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 shutdown_connections 2024-09-06T15:04:17.395 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:17.392+0000 7fb55ea5d640 1 -- 172.21.15.189:0/2187292722 wait complete. 2024-09-06T15:04:17.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:17 smithi189 bash[22757]: cluster 2024-09-06T15:04:16.111347+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:17.437 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:17 smithi189 bash[22757]: cluster 2024-09-06T15:04:16.111347+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:18.037 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch host ls --format=json 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.391345+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.391345+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: cephadm 2024-09-06T15:04:17.392191+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Added host smithi190 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: cephadm 2024-09-06T15:04:17.392191+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Added host smithi190 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.392886+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.392886+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.902112+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: audit 2024-09-06T15:04:17.902112+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: cluster 2024-09-06T15:04:18.111727+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:18.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:18 smithi189 bash[22757]: cluster 2024-09-06T15:04:18.111727+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:20 smithi189 bash[22757]: audit 2024-09-06T15:04:19.436559+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:20 smithi189 bash[22757]: audit 2024-09-06T15:04:19.436559+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:20 smithi189 bash[22757]: cluster 2024-09-06T15:04:20.112134+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:20 smithi189 bash[22757]: cluster 2024-09-06T15:04:20.112134+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:22.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:21 smithi189 bash[22757]: audit 2024-09-06T15:04:20.693960+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:22.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:21 smithi189 bash[22757]: audit 2024-09-06T15:04:20.693960+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:22.757 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:04:23.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:22 smithi189 bash[22757]: cluster 2024-09-06T15:04:22.112587+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:23.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:22 smithi189 bash[22757]: cluster 2024-09-06T15:04:22.112587+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:23.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/277043812 >> v1:172.21.15.189:6789/0 conn(0x7ffb701031e0 legacy=0x7ffb701035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:23.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/277043812 shutdown_connections 2024-09-06T15:04:23.873 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/277043812 >> 172.21.15.189:0/277043812 conn(0x7ffb700fcd50 msgr2=0x7ffb700ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:23.874 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/277043812 shutdown_connections 2024-09-06T15:04:23.874 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/277043812 wait complete. 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 Processor -- start 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- start start 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffb70102e00 con 0x7ffb701031e0 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb74fbf640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ffb701031e0 0x7ffb70101060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:41862/0 (socket says 172.21.15.189:41862) 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb74fbf640 1 -- 172.21.15.189:0/935019308 learned_addr learned my addr 172.21.15.189:0/935019308 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910368997 0 0) 0x7ffb70102e00 con 0x7ffb701031e0 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb580054b0 con 0x7ffb701031e0 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4021685897 0 0) 0x7ffb580054b0 con 0x7ffb701031e0 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb70102e00 con 0x7ffb701031e0 2024-09-06T15:04:23.875 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ffb6c001960 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1665210635 0 0) 0x7ffb70102e00 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb70101770 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb70101a60 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb701a20d0 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7ffb6c001d10 con 0x7ffb701031e0 2024-09-06T15:04:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7ffb6c004c10 con 0x7ffb701031e0 2024-09-06T15:04:23.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c0050b0 con 0x7ffb701031e0 2024-09-06T15:04:23.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7ffb6c004dd0 con 0x7ffb701031e0 2024-09-06T15:04:23.877 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.872+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7ffb6c04d180 con 0x7ffb701031e0 2024-09-06T15:04:23.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:23.876+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ffb6c020310 con 0x7ffb701031e0 2024-09-06T15:04:24.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.048+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb5c000bc0 con 0x7ffb5803ebb0 2024-09-06T15:04:24.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb65ffb640 1 -- 172.21.15.189:0/935019308 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (unknown 0 0 514875823) 0x7ffb5c000bc0 con 0x7ffb5803ebb0 2024-09-06T15:04:24.054 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:04:24.054 INFO:teuthology.orchestra.run.smithi189.stdout:[{"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}, {"addr": "172.21.15.190", "hostname": "smithi190", "labels": [], "status": ""}] 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 >> v1:172.21.15.189:6800/4002094494 conn(0x7ffb5803ebb0 legacy=0x7ffb58041070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 >> v1:172.21.15.189:6789/0 conn(0x7ffb701031e0 legacy=0x7ffb70101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 shutdown_connections 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 >> 172.21.15.189:0/935019308 conn(0x7ffb700fcd50 msgr2=0x7ffb70108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 shutdown_connections 2024-09-06T15:04:24.056 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:24.052+0000 7ffb77223640 1 -- 172.21.15.189:0/935019308 wait complete. 2024-09-06T15:04:24.644 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-06T15:04:24.644 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd crush tunables default 2024-09-06T15:04:25.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:25 smithi189 bash[22757]: audit 2024-09-06T15:04:24.054661+0000 mgr.y (mgr.14146) 34 : audit [DBG] from='client.14174 v1:172.21.15.189:0/935019308' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:04:25.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:25 smithi189 bash[22757]: audit 2024-09-06T15:04:24.054661+0000 mgr.y (mgr.14146) 34 : audit [DBG] from='client.14174 v1:172.21.15.189:0/935019308' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:04:25.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:25 smithi189 bash[22757]: cluster 2024-09-06T15:04:24.113028+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:25.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:25 smithi189 bash[22757]: cluster 2024-09-06T15:04:24.113028+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:27.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: cluster 2024-09-06T15:04:26.113437+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:27.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: cluster 2024-09-06T15:04:26.113437+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:27.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.606963+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.606963+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.614879+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.614879+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.623465+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.623465+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.631077+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.631077+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.632803+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"} : dispatch 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.632803+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"} : dispatch 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.634743+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.634743+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.636246+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:27.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:27 smithi189 bash[22757]: audit 2024-09-06T15:04:26.636246+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.638755+0000 mgr.y (mgr.14146) 37 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.638755+0000 mgr.y (mgr.14146) 37 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.814253+0000 mgr.y (mgr.14146) 38 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.814253+0000 mgr.y (mgr.14146) 38 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.964697+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:26.964697+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:28.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:27.109667+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: cephadm 2024-09-06T15:04:27.109667+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.258930+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.258930+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.264800+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.264800+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.270834+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:28.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:28 smithi189 bash[22757]: audit 2024-09-06T15:04:27.270834+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:29.369 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:04:29.460 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:29 smithi189 bash[22757]: cluster 2024-09-06T15:04:28.113866+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:29.460 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:29 smithi189 bash[22757]: cluster 2024-09-06T15:04:28.113866+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:30.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.524+0000 7fb1053dd640 1 -- 172.21.15.189:0/1626795705 >> v1:172.21.15.189:6789/0 conn(0x7fb1001025f0 legacy=0x7fb1001029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:30.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/1626795705 shutdown_connections 2024-09-06T15:04:30.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/1626795705 >> 172.21.15.189:0/1626795705 conn(0x7fb100077dd0 msgr2=0x7fb1000781e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:30.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/1626795705 shutdown_connections 2024-09-06T15:04:30.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/1626795705 wait complete. 2024-09-06T15:04:30.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 Processor -- start 2024-09-06T15:04:30.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- start start 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb100197800 con 0x7fb1001025f0 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0feffd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb1001025f0 0x7fb1001970f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40960/0 (socket says 172.21.15.189:40960) 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0feffd640 1 -- 172.21.15.189:0/2766794952 learned_addr learned my addr 172.21.15.189:0/2766794952 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384514617 0 0) 0x7fb100197800 con 0x7fb1001025f0 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e80054b0 con 0x7fb1001025f0 2024-09-06T15:04:30.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3426231676 0 0) 0x7fb0e80054b0 con 0x7fb1001025f0 2024-09-06T15:04:30.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb100197800 con 0x7fb1001025f0 2024-09-06T15:04:30.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb0f0001960 con 0x7fb1001025f0 2024-09-06T15:04:30.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1553929137 0 0) 0x7fb100197800 con 0x7fb1001025f0 2024-09-06T15:04:30.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1001979d0 con 0x7fb1001025f0 2024-09-06T15:04:30.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb100197cc0 con 0x7fb1001025f0 2024-09-06T15:04:30.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb10019fe30 con 0x7fb1001025f0 2024-09-06T15:04:30.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fb0f0004400 con 0x7fb1001025f0 2024-09-06T15:04:30.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fb0f0004c10 con 0x7fb1001025f0 2024-09-06T15:04:30.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fb0f0004dd0 con 0x7fb1001025f0 2024-09-06T15:04:30.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec005080 con 0x7fb1001025f0 2024-09-06T15:04:30.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.528+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 983+0+0 (unknown 4277466868 0 0) 0x7fb0f004d1b0 con 0x7fb1001025f0 2024-09-06T15:04:30.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.532+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fb0f0003ab0 con 0x7fb1001025f0 2024-09-06T15:04:30.704 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:30.700+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb0ec005370 con 0x7fb1001025f0 2024-09-06T15:04:31.169 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.168+0000 7fb0e7fff640 1 -- 172.21.15.189:0/2766794952 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (unknown 3126668360 0 0) 0x7fb0f0020810 con 0x7fb1001025f0 2024-09-06T15:04:31.169 INFO:teuthology.orchestra.run.smithi189.stderr:adjusted tunables profile to default 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 >> v1:172.21.15.189:6800/4002094494 conn(0x7fb0e8043020 legacy=0x7fb0e80454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 >> v1:172.21.15.189:6789/0 conn(0x7fb1001025f0 legacy=0x7fb1001970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 shutdown_connections 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 >> 172.21.15.189:0/2766794952 conn(0x7fb100077dd0 msgr2=0x7fb100107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 shutdown_connections 2024-09-06T15:04:31.175 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:04:31.172+0000 7fb1053dd640 1 -- 172.21.15.189:0/2766794952 wait complete. 2024-09-06T15:04:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:31 smithi189 bash[22757]: cluster 2024-09-06T15:04:30.114359+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:31 smithi189 bash[22757]: cluster 2024-09-06T15:04:30.114359+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:31 smithi189 bash[22757]: audit 2024-09-06T15:04:30.706312+0000 mon.a (mon.0) 132 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-06T15:04:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:31 smithi189 bash[22757]: audit 2024-09-06T15:04:30.706312+0000 mon.a (mon.0) 132 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-06T15:04:31.758 INFO:tasks.cephadm:Adding mon.a on smithi189 2024-09-06T15:04:31.758 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-06T15:04:31.758 INFO:tasks.cephadm:Adding mon.b on smithi190 2024-09-06T15:04:31.758 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply mon '3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b' 2024-09-06T15:04:32.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:32 smithi189 bash[22757]: audit 2024-09-06T15:04:31.170809+0000 mon.a (mon.0) 133 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-06T15:04:32.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:32 smithi189 bash[22757]: audit 2024-09-06T15:04:31.170809+0000 mon.a (mon.0) 133 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-06T15:04:32.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:32 smithi189 bash[22757]: cluster 2024-09-06T15:04:31.176161+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:32.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:32 smithi189 bash[22757]: cluster 2024-09-06T15:04:31.176161+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:32.985 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:33 smithi189 bash[22757]: cluster 2024-09-06T15:04:32.114898+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:33.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:33 smithi189 bash[22757]: cluster 2024-09-06T15:04:32.114898+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:34.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/751716029 >> v1:172.21.15.189:6789/0 conn(0x7f7330103310 legacy=0x7f73301036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:34.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/751716029 shutdown_connections 2024-09-06T15:04:34.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/751716029 >> 172.21.15.190:0/751716029 conn(0x7f73300fcd50 msgr2=0x7f73300ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:34.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/751716029 shutdown_connections 2024-09-06T15:04:34.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/751716029 wait complete. 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 Processor -- start 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- start start 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f73301976d0 con 0x7f7330103310 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f732e59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f7330103310 0x7f7330196fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.190:53098/0 (socket says 172.21.15.190:53098) 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f732e59c640 1 -- 172.21.15.190:0/1151288790 learned_addr learned my addr 172.21.15.190:0/1151288790 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419126814 0 0) 0x7f73301976d0 con 0x7f7330103310 2024-09-06T15:04:34.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318003520 con 0x7f7330103310 2024-09-06T15:04:34.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4146190360 0 0) 0x7f7318003520 con 0x7f7330103310 2024-09-06T15:04:34.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73301976d0 con 0x7f7330103310 2024-09-06T15:04:34.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7328001730 con 0x7f7330103310 2024-09-06T15:04:34.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1287965015 0 0) 0x7f73301976d0 con 0x7f7330103310 2024-09-06T15:04:34.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73301978a0 con 0x7f7330103310 2024-09-06T15:04:34.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7330197b90 con 0x7f7330103310 2024-09-06T15:04:34.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f733019fc80 con 0x7f7330103310 2024-09-06T15:04:34.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f7328001550 con 0x7f7330103310 2024-09-06T15:04:34.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7f7328004e40 con 0x7f7330103310 2024-09-06T15:04:34.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.042+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73100050b0 con 0x7f7330103310 2024-09-06T15:04:34.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.046+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7f7328001d70 con 0x7f7330103310 2024-09-06T15:04:34.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.046+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7f732804d360 con 0x7f7330103310 2024-09-06T15:04:34.059 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.058+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f7328020480 con 0x7f7330103310 2024-09-06T15:04:34.239 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.234+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b", "target": ["mon-mgr", ""]}) -- 0x7f7310000ca0 con 0x7f731803ecb0 2024-09-06T15:04:34.252 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f731f7fe640 1 -- 172.21.15.190:0/1151288790 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 3265049985) 0x7f7310000ca0 con 0x7f731803ecb0 2024-09-06T15:04:34.252 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mon update... 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 >> v1:172.21.15.189:6800/4002094494 conn(0x7f731803ecb0 legacy=0x7f7318041170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 >> v1:172.21.15.189:6789/0 conn(0x7f7330103310 legacy=0x7f7330196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 shutdown_connections 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 >> 172.21.15.190:0/1151288790 conn(0x7f73300fcd50 msgr2=0x7f7330108540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 shutdown_connections 2024-09-06T15:04:34.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:34.250+0000 7f7334e7f640 1 -- 172.21.15.190:0/1151288790 wait complete. 2024-09-06T15:04:34.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:34 smithi189 bash[22757]: cluster 2024-09-06T15:04:34.115414+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:34.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:34 smithi189 bash[22757]: cluster 2024-09-06T15:04:34.115414+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:34.774 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.c.service 2024-09-06T15:04:34.777 DEBUG:teuthology.orchestra.run.smithi190:mon.b> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.b.service 2024-09-06T15:04:34.779 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-06T15:04:34.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T15:04:35.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.242538+0000 mgr.y (mgr.14146) 45 : audit [DBG] from='client.14178 v1:172.21.15.190:0/1151288790' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.242538+0000 mgr.y (mgr.14146) 45 : audit [DBG] from='client.14178 v1:172.21.15.190:0/1151288790' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: cephadm 2024-09-06T15:04:34.247821+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Saving service mon spec with placement smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b;count:3 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: cephadm 2024-09-06T15:04:34.247821+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Saving service mon spec with placement smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b;count:3 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.252522+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.252522+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.254097+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.254097+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.257244+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.257244+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.258842+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:35.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.258842+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.266216+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.266216+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.270326+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.270326+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.271843+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: audit 2024-09-06T15:04:34.271843+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: cephadm 2024-09-06T15:04:34.273785+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Deploying daemon mon.b on smithi190 2024-09-06T15:04:35.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:35 smithi189 bash[22757]: cephadm 2024-09-06T15:04:34.273785+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Deploying daemon mon.b on smithi190 2024-09-06T15:04:36.019 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:36.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:36 smithi189 bash[22757]: cluster 2024-09-06T15:04:36.115929+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:36.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:36 smithi189 bash[22757]: cluster 2024-09-06T15:04:36.115929+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:37.834 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.830+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2804236352 >> v1:172.21.15.189:6789/0 conn(0x7fd3f4104600 legacy=0x7fd3f41049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:37.835 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.830+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2804236352 shutdown_connections 2024-09-06T15:04:37.835 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.830+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2804236352 >> 172.21.15.190:0/2804236352 conn(0x7fd3f4100010 msgr2=0x7fd3f4102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:37.835 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.830+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2804236352 shutdown_connections 2024-09-06T15:04:37.835 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.830+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2804236352 wait complete. 2024-09-06T15:04:37.836 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 Processor -- start 2024-09-06T15:04:37.836 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 -- start start 2024-09-06T15:04:37.836 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd3f41997b0 con 0x7fd3f4104600 2024-09-06T15:04:37.836 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f259c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fd3f4104600 0x7fd3f41990a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.190:53118/0 (socket says 172.21.15.190:53118) 2024-09-06T15:04:37.836 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f259c640 1 -- 172.21.15.190:0/2045104663 learned_addr learned my addr 172.21.15.190:0/2045104663 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:04:37.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476067858 0 0) 0x7fd3f41997b0 con 0x7fd3f4104600 2024-09-06T15:04:37.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3dc0054b0 con 0x7fd3f4104600 2024-09-06T15:04:37.837 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 545715732 0 0) 0x7fd3dc0054b0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3f41997b0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd3e8001960 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 165230374 0 0) 0x7fd3f41997b0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f4199980 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f4199c70 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd3f41a1de0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fd3e80046d0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 170+0+0 (unknown 3959990984 0 0) 0x7fd3e8004ab0 con 0x7fd3f4104600 2024-09-06T15:04:37.838 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d40050b0 con 0x7fd3f4104600 2024-09-06T15:04:37.839 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.834+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fd3e8003800 con 0x7fd3f4104600 2024-09-06T15:04:37.839 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.838+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7fd3e804ced0 con 0x7fd3f4104600 2024-09-06T15:04:37.851 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:37.846+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fd3e80174f0 con 0x7fd3f4104600 2024-09-06T15:04:38.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.082+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd3d40053a0 con 0x7fd3f4104600 2024-09-06T15:04:38.125 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.082+0000 7fd3e37fe640 1 -- 172.21.15.190:0/2045104663 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+697 (unknown 2237029548 0 3521479634) 0x7fd3e801fff0 con 0x7fd3f4104600 2024-09-06T15:04:38.125 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 1 2024-09-06T15:04:38.125 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":1,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","modified":"2024-09-06T15:02:33.166897Z","created":"2024-09-06T15:02:33.166897Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 >> v1:172.21.15.189:6800/4002094494 conn(0x7fd3dc03ec40 legacy=0x7fd3dc041100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 >> v1:172.21.15.189:6789/0 conn(0x7fd3f4104600 legacy=0x7fd3f41990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 shutdown_connections 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 >> 172.21.15.190:0/2045104663 conn(0x7fd3f4100010 msgr2=0x7fd3f410a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:38.126 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 shutdown_connections 2024-09-06T15:04:38.127 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:38.086+0000 7fd3f8f7e640 1 -- 172.21.15.190:0/2045104663 wait complete. 2024-09-06T15:04:38.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:38 smithi189 bash[22757]: audit 2024-09-06T15:04:38.087172+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? v1:172.21.15.190:0/2045104663' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:38.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:38 smithi189 bash[22757]: audit 2024-09-06T15:04:38.087172+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? v1:172.21.15.190:0/2045104663' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:39.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:39 smithi189 bash[22757]: cluster 2024-09-06T15:04:38.116351+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:39.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:39 smithi189 bash[22757]: cluster 2024-09-06T15:04:38.116351+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:39.846 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-06T15:04:39.847 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T15:04:40.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:40 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:04:40.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:40 smithi190 systemd[1]: Started Ceph mon.b for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:04:41.078 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: cluster 2024-09-06T15:04:40.116796+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: cluster 2024-09-06T15:04:40.116796+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.207187+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.207187+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.214995+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.214995+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.223289+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.223289+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.224699+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.224699+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.226201+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:41 smithi189 bash[22757]: audit 2024-09-06T15:04:40.226201+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.262+0000 7f34650f9c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.262+0000 7f34650f9c80 0 ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev), process ceph-mon, pid 7 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.262+0000 7f34650f9c80 0 pidfile_write: ignore empty --pid-file 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 0 load: jerasure load: lrc 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: RocksDB version: 7.9.2 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Git sha 0 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Compile date 2024-09-04 13:52:53 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: DB SUMMARY 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: DB Session ID: KU72KI0UF6EZ6BPBCKLG 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: CURRENT file: CURRENT 2024-09-06T15:04:41.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: IDENTITY file: IDENTITY 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 476 ; 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.error_if_exists: 0 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.create_if_missing: 0 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.paranoid_checks: 1 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.env: 0x55d7571a3160 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.fs: PosixFileSystem 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.info_log: 0x55d758db7800 2024-09-06T15:04:41.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.statistics: (nil) 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.use_fsync: 0 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_log_file_size: 0 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T15:04:41.632 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_fallocate: 1 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.use_direct_reads: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.create_missing_column_families: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.db_log_dir: 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.wal_dir: 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T15:04:41.633 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.advise_random_on_open: 1 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.write_buffer_manager: 0x55d758dbae60 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.rate_limiter: (nil) 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-06T15:04:41.634 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.unordered_write: 0 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.row_cache: None 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.wal_filter: None 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-06T15:04:41.635 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.two_write_queues: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.manual_wal_flush: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.wal_compression: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.atomic_flush: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.log_readahead_size: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-06T15:04:41.636 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_background_jobs: 2 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_background_compactions: -1 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_subcompactions: 1 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_total_wal_size: 0 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_open_files: -1 2024-09-06T15:04:41.637 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bytes_per_sync: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_background_flushes: -1 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Compression algorithms supported: 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kZSTD supported: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kXpressCompression supported: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kBZip2Compression supported: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T15:04:41.638 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kLZ4Compression supported: 1 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kZlibCompression supported: 1 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: kSnappyCompression supported: 1 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-06T15:04:41.639 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.merge_operator: 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_filter: None 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_filter_factory: None 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-06T15:04:41.641 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d758db7440) 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cache_index_and_filter_blocks: 1 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: pin_top_level_index_and_filter: 1 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: index_type: 0 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: data_block_index_type: 0 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: index_shortening: 1 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: data_block_hash_table_util_ratio: 0.750000 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: checksum: 4 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: no_block_cache: 0 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_cache: 0x55d758dac850 2024-09-06T15:04:41.642 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_cache_name: BinnedLRUCache 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_cache_options: 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: capacity : 536870912 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: num_shard_bits : 4 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: strict_capacity_limit : 0 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: high_pri_pool_ratio: 0.000 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_cache_compressed: (nil) 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: persistent_cache: (nil) 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_size: 4096 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_size_deviation: 10 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_restart_interval: 16 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: index_block_restart_interval: 1 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: metadata_block_size: 4096 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: partition_filters: 0 2024-09-06T15:04:41.643 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: use_delta_encoding: 1 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: filter_policy: bloomfilter 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: whole_key_filtering: 1 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: verify_compression: 0 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: read_amp_bytes_per_bit: 0 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: format_version: 5 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: enable_index_compression: 1 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: block_align: 0 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: max_auto_readahead_size: 262144 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: prepopulate_block_cache: 0 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: initial_auto_readahead_size: 8192 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: num_file_reads_for_auto_readahead: 2 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-06T15:04:41.644 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression: NoCompression 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.num_levels: 7 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T15:04:41.645 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.level: 32767 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T15:04:41.646 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.enabled: false 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T15:04:41.647 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.arena_block_size: 1048576 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T15:04:41.648 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.inplace_update_support: 0 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T15:04:41.649 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.bloom_locality: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.max_successive_merges: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.force_consistency_checks: 1 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.ttl: 2592000 2024-09-06T15:04:41.650 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enable_blob_files: false 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.min_blob_size: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_file_size: 268435456 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-06T15:04:41.651 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 793f557c-0097-4874-85ee-4083303de658 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725635081272976, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.266+0000 7f34650f9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725635081273599, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1613, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 488, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 366, "raw_average_value_size": 73, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725635081, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "793f557c-0097-4874-85ee-4083303de658", "db_session_id": "KU72KI0UF6EZ6BPBCKLG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1725635081273755, "job": 1, "event": "recovery_finished"} 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d758ddae00 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 4 rocksdb: DB pointer 0x55d758ede000 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f345aec1640 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f345aec1640 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T15:04:41.652 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: ** DB Stats ** 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: ** Compaction Stats [default] ** 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T15:04:41.653 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: ** Compaction Stats [default] ** 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-06T15:04:41.654 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: AddFile(Total Files): cumulative 0, interval 0 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: AddFile(Keys): cumulative 0, interval 0 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Cumulative compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Interval compaction: 0.00 GB write, 0.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Block cache BinnedLRUCache@0x55d758dac850#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: ** File Read Latency Histogram By Level [default] ** 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 0 using public_addrv v1:172.21.15.190:6789/0 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.270+0000 7f34650f9c80 0 starting mon.b rank -1 at public addrs v1:172.21.15.190:6789/0 at bind addrs v1:172.21.15.190:6789/0 mon_data /var/lib/ceph/mon/ceph-b fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:41.655 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.274+0000 7f34650f9c80 1 mon.b@-1(???) e0 preinit fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: e1 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: btime 2024-09-06T15:02:37:979262+0000 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: legacy client fscid: -1 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: No filesystems configured 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-06T15:04:41.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.294+0000 7f345dec7640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:04.108680+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:04.108680+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:06.109066+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:06.109066+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.408181+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.657 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.408181+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.409643+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.409643+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.412159+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.412159+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.412980+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.412980+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.792508+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.792508+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.795584+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.795584+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.798872+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.798872+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.402767+0000 mgr.y (mgr.14146) 18 : audit [DBG] from='client.14170 v1:172.21.15.189:0/2415560975' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.658 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:06.402767+0000 mgr.y (mgr.14146) 18 : audit [DBG] from='client.14170 v1:172.21.15.189:0/2415560975' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.413983+0000 mgr.y (mgr.14146) 19 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.413983+0000 mgr.y (mgr.14146) 19 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.503063+0000 mgr.y (mgr.14146) 20 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.503063+0000 mgr.y (mgr.14146) 20 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.586695+0000 mgr.y (mgr.14146) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.586695+0000 mgr.y (mgr.14146) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.673470+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:06.673470+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:08.109496+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:08.109496+0000 mgr.y (mgr.14146) 23 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:10.109977+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:10.109977+0000 mgr.y (mgr.14146) 24 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.659 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:12.110481+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:12.110481+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:13.132875+0000 mgr.y (mgr.14146) 26 : audit [DBG] from='client.14172 v1:172.21.15.189:0/2187292722' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:13.132875+0000 mgr.y (mgr.14146) 26 : audit [DBG] from='client.14172 v1:172.21.15.189:0/2187292722' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi190", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:14.110941+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:14.110941+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:14.146350+0000 mgr.y (mgr.14146) 28 : cephadm [INF] Deploying cephadm binary to smithi190 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:14.146350+0000 mgr.y (mgr.14146) 28 : cephadm [INF] Deploying cephadm binary to smithi190 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:16.111347+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:16.111347+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.391345+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.391345+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.660 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:17.392191+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Added host smithi190 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:17.392191+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Added host smithi190 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.392886+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.392886+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.902112+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:17.902112+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:18.111727+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:18.111727+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:19.436559+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:19.436559+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:20.112134+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:20.112134+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:20.693960+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:20.693960+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.661 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:22.112587+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:22.112587+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:24.054661+0000 mgr.y (mgr.14146) 34 : audit [DBG] from='client.14174 v1:172.21.15.189:0/935019308' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:24.054661+0000 mgr.y (mgr.14146) 34 : audit [DBG] from='client.14174 v1:172.21.15.189:0/935019308' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:24.113028+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:24.113028+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:26.113437+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:26.113437+0000 mgr.y (mgr.14146) 36 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.606963+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.606963+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.614879+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.614879+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.623465+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.662 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.623465+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.631077+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.631077+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.632803+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.632803+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd/host:smithi190", "name": "osd_memory_target"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.634743+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.634743+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.636246+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:26.636246+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.638755+0000 mgr.y (mgr.14146) 37 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.638755+0000 mgr.y (mgr.14146) 37 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.814253+0000 mgr.y (mgr.14146) 38 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.814253+0000 mgr.y (mgr.14146) 38 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:04:41.663 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.964697+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:26.964697+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:27.109667+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:27.109667+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.258930+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.258930+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.264800+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.664 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.264800+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.270834+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:27.270834+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:28.113866+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:28.113866+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:30.114359+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:30.114359+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:30.706312+0000 mon.a (mon.0) 132 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:30.706312+0000 mon.a (mon.0) 132 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:31.170809+0000 mon.a (mon.0) 133 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:31.170809+0000 mon.a (mon.0) 133 : audit [INF] from='client.? v1:172.21.15.189:0/2766794952' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:31.176161+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:41.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:31.176161+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:41.666 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:32.114898+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.666 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:32.114898+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.666 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:34.115414+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.666 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:34.115414+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.666 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.242538+0000 mgr.y (mgr.14146) 45 : audit [DBG] from='client.14178 v1:172.21.15.190:0/1151288790' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.242538+0000 mgr.y (mgr.14146) 45 : audit [DBG] from='client.14178 v1:172.21.15.190:0/1151288790' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:34.247821+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Saving service mon spec with placement smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b;count:3 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:34.247821+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Saving service mon spec with placement smithi189:[v1:172.21.15.189:6789]=a;smithi189:[v1:172.21.15.189:6790]=c;smithi190:[v1:172.21.15.190:6789]=b;count:3 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.252522+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.252522+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.254097+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.254097+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.257244+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.257244+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.258842+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.258842+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.266216+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.667 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.266216+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.270326+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.270326+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.271843+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:34.271843+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:34.273785+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Deploying daemon mon.b on smithi190 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cephadm 2024-09-06T15:04:34.273785+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Deploying daemon mon.b on smithi190 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:36.115929+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:36.115929+0000 mgr.y (mgr.14146) 48 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:38.087172+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? v1:172.21.15.190:0/2045104663' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:38.087172+0000 mon.a (mon.0) 142 : audit [DBG] from='client.? v1:172.21.15.190:0/2045104663' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:38.116351+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:38.116351+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.668 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:40.116796+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: cluster 2024-09-06T15:04:40.116796+0000 mgr.y (mgr.14146) 50 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.207187+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.207187+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.214995+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.214995+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.223289+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.223289+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.224699+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.224699+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.226201+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: audit 2024-09-06T15:04:40.226201+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:41.669 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:41 smithi190 bash[24979]: debug 2024-09-06T15:04:41.298+0000 7f345dec7640 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-06T15:04:44.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:44 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:04:44.353 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:04:44 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:04:44.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:44 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:04:44.853 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:04:44 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:04:45.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:45 smithi189 bash[29727]: debug 2024-09-06T15:04:45.655+0000 7fd15517c640 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-06T15:04:46.393 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- 172.21.15.190:0/2686567706 >> v1:172.21.15.189:6789/0 conn(0x7f8a54003470 legacy=0x7f8a540038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.393 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- 172.21.15.190:0/2686567706 shutdown_connections 2024-09-06T15:04:46.393 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- 172.21.15.190:0/2686567706 >> 172.21.15.190:0/2686567706 conn(0x7f8a7406ea10 msgr2=0x7f8a7406ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:46.393 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- 172.21.15.190:0/2686567706 shutdown_connections 2024-09-06T15:04:46.393 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- 172.21.15.190:0/2686567706 wait complete. 2024-09-06T15:04:46.394 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 Processor -- start 2024-09-06T15:04:46.394 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.390+0000 7f8a7936f640 1 -- start start 2024-09-06T15:04:46.395 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a7936f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8a741a9710 con 0x7f8a7419dcb0 2024-09-06T15:04:46.395 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a7936f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8a741aa8f0 con 0x7f8a54003470 2024-09-06T15:04:46.395 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a72ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f8a54003470 0x7f8a7419d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:39002/0 (socket says 172.21.15.190:39002) 2024-09-06T15:04:46.395 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a72ffd640 1 -- 172.21.15.190:0/3536333800 learned_addr learned my addr 172.21.15.190:0/3536333800 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:04:46.396 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081849584 0 0) 0x7f8a741a9710 con 0x7f8a7419dcb0 2024-09-06T15:04:46.396 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a60003520 con 0x7f8a7419dcb0 2024-09-06T15:04:46.397 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3993627009 0 0) 0x7f8a60003520 con 0x7f8a7419dcb0 2024-09-06T15:04:46.397 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a741a9710 con 0x7f8a7419dcb0 2024-09-06T15:04:46.397 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 239+0+0 (unknown 3249050517 0 0) 0x7f8a5c001860 con 0x7f8a7419dcb0 2024-09-06T15:04:46.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4260657991 0 0) 0x7f8a741a9710 con 0x7f8a7419dcb0 2024-09-06T15:04:46.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 >> v1:172.21.15.190:6789/0 conn(0x7f8a54003470 legacy=0x7f8a7419d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a741abad0 con 0x7f8a7419dcb0 2024-09-06T15:04:46.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a741a9940 con 0x7f8a7419dcb0 2024-09-06T15:04:46.398 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.394+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a741a9f20 con 0x7f8a7419dcb0 2024-09-06T15:04:46.399 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.398+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a740748e0 con 0x7f8a7419dcb0 2024-09-06T15:04:46.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.398+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f8a5c003a60 con 0x7f8a7419dcb0 2024-09-06T15:04:46.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.398+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 239+0+0 (unknown 3249050517 0 0) 0x7f8a5c004950 con 0x7f8a7419dcb0 2024-09-06T15:04:46.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.402+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7f8a5c0035f0 con 0x7f8a7419dcb0 2024-09-06T15:04:46.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.402+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7f8a5c04bf50 con 0x7f8a7419dcb0 2024-09-06T15:04:46.415 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.414+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f8a5c01f0e0 con 0x7f8a7419dcb0 2024-09-06T15:04:46.659 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.654+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f8a741aa2b0 con 0x7f8a7419dcb0 2024-09-06T15:04:46.659 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a6bfff640 1 -- 172.21.15.190:0/3536333800 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+915 (unknown 3557084514 0 2262954355) 0x7f8a5c048f70 con 0x7f8a7419dcb0 2024-09-06T15:04:46.659 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 2 2024-09-06T15:04:46.660 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:04:46.660 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":2,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","modified":"2024-09-06T15:04:41.306901Z","created":"2024-09-06T15:02:33.166897Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 >> v1:172.21.15.189:6800/4002094494 conn(0x7f8a6003ee60 legacy=0x7f8a60041320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 >> v1:172.21.15.189:6789/0 conn(0x7f8a7419dcb0 legacy=0x7f8a741a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 shutdown_connections 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 >> 172.21.15.190:0/3536333800 conn(0x7f8a7406ea10 msgr2=0x7f8a7410d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 shutdown_connections 2024-09-06T15:04:46.662 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:46.658+0000 7f8a7936f640 1 -- 172.21.15.190:0/3536333800 wait complete. 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.701 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.702 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:46.703 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:46.704 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.705 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.706 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:46 smithi190 bash[24979]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:46.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:46.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:46.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:46.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:46.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:46.856 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:46.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:46.859 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:46 smithi189 bash[22757]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:47.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:47.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:47.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:47.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:47.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:47.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:47.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:47.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:47 smithi190 bash[24979]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:47.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:47 smithi189 bash[22757]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:48.229 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-06T15:04:48.230 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T15:04:52.522 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:04:52.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:52.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:52.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:52.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:52.883 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:52.884 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.885 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:52.886 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:52 smithi190 bash[24979]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:53.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:53.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:52 smithi189 bash[22757]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.716 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/792410096 >> v1:172.21.15.189:6789/0 conn(0x7fc23c101690 legacy=0x7fc23c101a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:53.716 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/792410096 shutdown_connections 2024-09-06T15:04:53.716 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/792410096 >> 172.21.15.190:0/792410096 conn(0x7fc23c0750e0 msgr2=0x7fc23c0754f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:53.716 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/792410096 shutdown_connections 2024-09-06T15:04:53.716 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/792410096 wait complete. 2024-09-06T15:04:53.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 Processor -- start 2024-09-06T15:04:53.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- start start 2024-09-06T15:04:53.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc23c1a91d0 con 0x7fc23c0ff070 2024-09-06T15:04:53.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc23c1aa3b0 con 0x7fc23c0febe0 2024-09-06T15:04:53.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc23c1ab590 con 0x7fc23c101690 2024-09-06T15:04:53.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc241242640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc23c0febe0 0x7fc23c1a42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:33944/0 (socket says 172.21.15.190:33944) 2024-09-06T15:04:53.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc241242640 1 -- 172.21.15.190:0/3408096640 learned_addr learned my addr 172.21.15.190:0/3408096640 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883773873 0 0) 0x7fc23c1aa3b0 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc228003c00 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877279467 0 0) 0x7fc23c1a91d0 con 0x7fc23c0ff070 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc23c1aa3b0 con 0x7fc23c0ff070 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1683104669 0 0) 0x7fc228003c00 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc23c1a91d0 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc2380018b0 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4160222448 0 0) 0x7fc23c1aa3b0 con 0x7fc23c0ff070 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc228003c00 con 0x7fc23c0ff070 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc234001bb0 con 0x7fc23c0ff070 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 759669545 0 0) 0x7fc23c1a91d0 con 0x7fc23c0febe0 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 >> v1:172.21.15.189:6790/0 conn(0x7fc23c101690 legacy=0x7fc23c0fe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:53.719 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 >> v1:172.21.15.189:6789/0 conn(0x7fc23c0ff070 legacy=0x7fc23c1a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c1ac830 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c1a9400 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc23c1a9a30 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fc238004d10 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc238005bd0 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fc2380121f0 con 0x7fc23c0febe0 2024-09-06T15:04:53.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.714+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220005080 con 0x7fc23c0febe0 2024-09-06T15:04:53.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.718+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7fc23804cfc0 con 0x7fc23c0febe0 2024-09-06T15:04:53.723 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.722+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fc238018570 con 0x7fc23c0febe0 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:53.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:53 smithi190 bash[24979]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:53.939 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.934+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc220005370 con 0x7fc23c0febe0 2024-09-06T15:04:53.939 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc232ffd640 1 -- 172.21.15.190:0/3408096640 <== mon.1 v1:172.21.15.190:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1131 (unknown 409899127 0 1216665243) 0x7fc238017e70 con 0x7fc23c0febe0 2024-09-06T15:04:53.939 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:04:53.940 INFO:teuthology.orchestra.run.smithi190.stdout:{"epoch":3,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","modified":"2024-09-06T15:04:47.664999Z","created":"2024-09-06T15:02:33.166897Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-06T15:04:53.940 INFO:teuthology.orchestra.run.smithi190.stderr:dumped monmap epoch 3 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 >> v1:172.21.15.189:6800/4002094494 conn(0x7fc22803ed60 legacy=0x7fc228041220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 >> v1:172.21.15.190:6789/0 conn(0x7fc23c0febe0 legacy=0x7fc23c1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 shutdown_connections 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 >> 172.21.15.190:0/3408096640 conn(0x7fc23c0750e0 msgr2=0x7fc23c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 shutdown_connections 2024-09-06T15:04:53.942 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:04:53.938+0000 7fc243ca7640 1 -- 172.21.15.190:0/3408096640 wait complete. 2024-09-06T15:04:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:54.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:53 smithi189 bash[22757]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.507 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-06T15:04:54.507 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph config generate-minimal-conf 2024-09-06T15:04:54.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:54.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:41.314518+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:54.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:41.314893+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:41.335810+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:42.117184+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:42.306950+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:43.307169+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:43.309424+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:44.117492+0000 mgr.y (mgr.14146) 53 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:44.306997+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:45.307513+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:45.663373+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.117887+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.307517+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.358832+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364795+0000 mon.a (mon.0) 159 : cluster [DBG] monmap epoch 2 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:54.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364823+0000 mon.a (mon.0) 160 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364838+0000 mon.a (mon.0) 161 : cluster [DBG] last_changed 2024-09-06T15:04:41.306901+0000 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364851+0000 mon.a (mon.0) 162 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364864+0000 mon.a (mon.0) 163 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364882+0000 mon.a (mon.0) 164 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364900+0000 mon.a (mon.0) 165 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.364915+0000 mon.a (mon.0) 166 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:54.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383551+0000 mon.a (mon.0) 167 : cluster [DBG] fsmap 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383598+0000 mon.a (mon.0) 168 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.383872+0000 mon.a (mon.0) 169 : cluster [DBG] mgrmap e13: y(active, since 68s) 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384125+0000 mon.a (mon.0) 170 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384150+0000 mon.a (mon.0) 171 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:46.384170+0000 mon.a (mon.0) 172 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.390498+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.397272+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.419579+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.426208+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.475105+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.660923+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? v1:172.21.15.190:0/3536333800' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:46.663668+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.308082+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.670567+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:47.671028+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:47.672038+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.692224+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:47.692495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:48.118410+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:48.664047+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:49.664327+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:50.118784+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:50.664390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.780 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:51.663815+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.119196+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.664715+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.692234+0000 mon.a (mon.0) 191 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698232+0000 mon.a (mon.0) 192 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:54.781 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698261+0000 mon.a (mon.0) 193 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698275+0000 mon.a (mon.0) 194 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698289+0000 mon.a (mon.0) 195 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:54.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698304+0000 mon.a (mon.0) 196 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698318+0000 mon.a (mon.0) 197 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698334+0000 mon.a (mon.0) 198 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698350+0000 mon.a (mon.0) 199 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:54.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.698366+0000 mon.a (mon.0) 200 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699554+0000 mon.a (mon.0) 201 : cluster [DBG] fsmap 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699603+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.699868+0000 mon.a (mon.0) 203 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.700166+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718932+0000 mon.a (mon.0) 205 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1/3 mons down, quorum a,b 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718967+0000 mon.a (mon.0) 206 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718982+0000 mon.a (mon.0) 207 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.718996+0000 mon.a (mon.0) 208 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:52.719012+0000 mon.a (mon.0) 209 : cluster [WRN] mon.c (rank 2) addr v1:172.21.15.189:6790/0 is down (out of quorum) 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.723617+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.728705+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.734117+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.740201+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.786 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:52.746682+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.426379+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.427834+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.663980+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.698259+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.703802+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.706973+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.787 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.710274+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.714256+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.747566+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.750109+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.754263+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.759043+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.759936+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.761084+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: audit 2024-09-06T15:04:53.762215+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:54.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:55.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.109 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.110 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[29727]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.111 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.112 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.113 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.113 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.113 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:54 smithi189 bash[22757]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:49.666765+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.702466+0000 mon.c (mon.2) 2 : cluster [INF] mon.c calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.702971+0000 mon.a (mon.0) 231 : cluster [INF] mon.a calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.703404+0000 mon.b (mon.1) 4 : cluster [INF] mon.b calling monitor election 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.724097+0000 mon.a (mon.0) 232 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727625+0000 mon.a (mon.0) 233 : cluster [DBG] monmap epoch 3 2024-09-06T15:04:55.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727639+0000 mon.a (mon.0) 234 : cluster [DBG] fsid de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727645+0000 mon.a (mon.0) 235 : cluster [DBG] last_changed 2024-09-06T15:04:47.664999+0000 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727652+0000 mon.a (mon.0) 236 : cluster [DBG] created 2024-09-06T15:02:33.166897+0000 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727658+0000 mon.a (mon.0) 237 : cluster [DBG] min_mon_release 19 (squid) 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727664+0000 mon.a (mon.0) 238 : cluster [DBG] election_strategy: 1 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727670+0000 mon.a (mon.0) 239 : cluster [DBG] 0: v1:172.21.15.189:6789/0 mon.a 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727676+0000 mon.a (mon.0) 240 : cluster [DBG] 1: v1:172.21.15.190:6789/0 mon.b 2024-09-06T15:04:55.131 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.727682+0000 mon.a (mon.0) 241 : cluster [DBG] 2: v1:172.21.15.189:6790/0 mon.c 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728074+0000 mon.a (mon.0) 242 : cluster [DBG] fsmap 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728095+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728218+0000 mon.a (mon.0) 244 : cluster [DBG] mgrmap e13: y(active, since 76s) 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.728332+0000 mon.a (mon.0) 245 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730829+0000 mon.a (mon.0) 246 : cluster [WRN] Health detail: HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.132 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730841+0000 mon.a (mon.0) 247 : cluster [WRN] [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.133 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:55.133 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:54 smithi190 bash[24979]: cluster 2024-09-06T15:04:54.730847+0000 mon.a (mon.0) 248 : cluster [WRN] Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:56.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:55 smithi189 bash[22757]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:56.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:55 smithi189 bash[22757]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:55 smithi189 bash[29727]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:55 smithi189 bash[29727]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:56.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:55 smithi190 bash[24979]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:56.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:55 smithi190 bash[24979]: audit 2024-09-06T15:04:55.664934+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[22757]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:57.356 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:57 smithi189 bash[29727]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.071278+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.076897+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cephadm 2024-09-06T15:04:56.078144+0000 mgr.y (mgr.14146) 65 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.078725+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.080066+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: audit 2024-09-06T15:04:56.081402+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cephadm 2024-09-06T15:04:56.083053+0000 mgr.y (mgr.14146) 66 : cephadm [INF] Reconfiguring daemon mon.c on smithi189 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:57.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:57 smithi190 bash[24979]: cluster 2024-09-06T15:04:56.119997+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.239 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[22757]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:59.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:04:59 smithi189 bash[29727]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: cluster 2024-09-06T15:04:58.120496+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.319836+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.326246+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.327721+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.328482+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:04:59.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:04:59 smithi190 bash[24979]: audit 2024-09-06T15:04:58.329237+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:00.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/3654484716 >> v1:172.21.15.189:6790/0 conn(0x7fbb1c1013d0 legacy=0x7fbb1c1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/3654484716 shutdown_connections 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/3654484716 >> 172.21.15.189:0/3654484716 conn(0x7fbb1c0fd240 msgr2=0x7fbb1c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/3654484716 shutdown_connections 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/3654484716 wait complete. 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 Processor -- start 2024-09-06T15:05:00.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- start start 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb1c1a98a0 con 0x7fbb1c111230 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb1c1aaaa0 con 0x7fbb1c101ec0 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb1c1abca0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb22231640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fbb1c1013d0 0x7fbb1c1109e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:60232/0 (socket says 172.21.15.189:60232) 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb22231640 1 -- 172.21.15.189:0/4200316253 learned_addr learned my addr 172.21.15.189:0/4200316253 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641763106 0 0) 0x7fbb1c1abca0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb08003520 con 0x7fbb1c1013d0 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415324838 0 0) 0x7fbb1c1a98a0 con 0x7fbb1c111230 2024-09-06T15:05:00.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c1abca0 con 0x7fbb1c111230 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825908648 0 0) 0x7fbb1c1aaaa0 con 0x7fbb1c101ec0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c1a98a0 con 0x7fbb1c101ec0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1823007433 0 0) 0x7fbb08003520 con 0x7fbb1c1013d0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb1c1aaaa0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb0c001af0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2769331617 0 0) 0x7fbb1c1abca0 con 0x7fbb1c111230 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb08003520 con 0x7fbb1c111230 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb14001c30 con 0x7fbb1c111230 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2522407388 0 0) 0x7fbb1c1aaaa0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 >> v1:172.21.15.190:6789/0 conn(0x7fbb1c101ec0 legacy=0x7fbb1c1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 >> v1:172.21.15.189:6789/0 conn(0x7fbb1c111230 legacy=0x7fbb1c1a7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:00.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c1acf40 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c1abed0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb1c1ac500 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbb0c001d20 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb0c004c40 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7fbb0c004e00 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.359+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb000050b0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.363+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7fbb0c04d150 con 0x7fbb1c1013d0 2024-09-06T15:05:00.369 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.367+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fbb0c018670 con 0x7fbb1c1013d0 2024-09-06T15:05:00.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:00 smithi190 bash[24979]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:00 smithi190 bash[24979]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:00 smithi190 bash[24979]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:00.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:00 smithi190 bash[24979]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:00.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.531+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fbb000053a0 con 0x7fbb1c1013d0 2024-09-06T15:05:00.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.531+0000 7fbb137fe640 1 -- 172.21.15.189:0/4200316253 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+193 (unknown 2189217731 0 3551353834) 0x7fbb0c017f70 con 0x7fbb1c1013d0 2024-09-06T15:05:00.535 INFO:teuthology.orchestra.run.smithi189.stdout:# minimal ceph.conf for de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:05:00.536 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-09-06T15:05:00.536 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:05:00.536 INFO:teuthology.orchestra.run.smithi189.stdout: mon_host = 172.21.15.189:6789/0 172.21.15.190:6789/0 v1:172.21.15.189:6790/0 2024-09-06T15:05:00.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 >> v1:172.21.15.189:6800/4002094494 conn(0x7fbb0803ec90 legacy=0x7fbb08041150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:00.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 >> v1:172.21.15.189:6790/0 conn(0x7fbb1c1013d0 legacy=0x7fbb1c1109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:00.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 shutdown_connections 2024-09-06T15:05:00.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 >> 172.21.15.189:0/4200316253 conn(0x7fbb1c0fd240 msgr2=0x7fbb1c1136f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:00.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 shutdown_connections 2024-09-06T15:05:00.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:00.535+0000 7fbb24495640 1 -- 172.21.15.189:0/4200316253 wait complete. 2024-09-06T15:05:00.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[29727]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[29727]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[29727]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[29727]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[22757]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[22757]: cephadm 2024-09-06T15:04:58.327386+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[22757]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:00.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:00 smithi189 bash[22757]: cephadm 2024-09-06T15:04:58.330395+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Reconfiguring daemon mon.b on smithi190 2024-09-06T15:05:01.157 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-06T15:05:01.157 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:05:01.157 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-06T15:05:01.172 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:05:01.172 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:05:01.226 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:05:01.226 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.conf 2024-09-06T15:05:01.240 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:05:01.240 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:05:01.296 INFO:tasks.cephadm:Adding mgr.y on smithi189 2024-09-06T15:05:01.296 INFO:tasks.cephadm:Adding mgr.x on smithi190 2024-09-06T15:05:01.296 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply mgr '2;smithi189=y;smithi190=x' 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.348 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.349 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:01 smithi190 bash[24979]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.588 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[22757]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: cluster 2024-09-06T15:05:00.120917+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.589 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.522362+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.531195+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.533249+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.535901+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.536988+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.537011+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? v1:172.21.15.189:0/4200316253' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:01.590 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:01 smithi189 bash[29727]: audit 2024-09-06T15:05:00.545407+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:03 smithi189 bash[22757]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:03 smithi189 bash[22757]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:03 smithi189 bash[29727]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:03 smithi189 bash[29727]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:03 smithi190 bash[24979]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:03 smithi190 bash[24979]: cluster 2024-09-06T15:05:02.121385+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:04 smithi189 bash[22757]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:04 smithi189 bash[22757]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:04 smithi189 bash[29727]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:04 smithi189 bash[29727]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:04 smithi190 bash[24979]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:04.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:04 smithi190 bash[24979]: cluster 2024-09-06T15:05:04.121854+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:05.053 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:05:06.169 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/229272474 >> v1:172.21.15.190:6789/0 conn(0x7f0774106b60 legacy=0x7f0774108f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:06.169 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/229272474 shutdown_connections 2024-09-06T15:05:06.169 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/229272474 >> 172.21.15.190:0/229272474 conn(0x7f07740fc4c0 msgr2=0x7f07740fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:06.169 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/229272474 shutdown_connections 2024-09-06T15:05:06.170 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/229272474 wait complete. 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 Processor -- start 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- start start 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f07741a2e60 con 0x7f077410a6a0 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f07741a4040 con 0x7f0774103b90 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f07741a5220 con 0x7f0774106b60 2024-09-06T15:05:06.171 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f0779139640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0774103b90 0x7f0774197dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:48466/0 (socket says 172.21.15.190:48466) 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f0779139640 1 -- 172.21.15.190:0/1737734693 learned_addr learned my addr 172.21.15.190:0/1737734693 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829697200 0 0) 0x7f07741a4040 con 0x7f0774103b90 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0760003520 con 0x7f0774103b90 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1950929514 0 0) 0x7f0760003520 con 0x7f0774103b90 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07741a4040 con 0x7f0774103b90 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f07640019f0 con 0x7f0774103b90 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668899291 0 0) 0x7f07741a2e60 con 0x7f077410a6a0 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0760003520 con 0x7f077410a6a0 2024-09-06T15:05:06.172 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 31821071 0 0) 0x7f07741a4040 con 0x7f0774103b90 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 >> v1:172.21.15.189:6790/0 conn(0x7f0774106b60 legacy=0x7f077419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 >> v1:172.21.15.189:6789/0 conn(0x7f077410a6a0 legacy=0x7f07741a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07741a6400 con 0x7f0774103b90 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f07741a3090 con 0x7f0774103b90 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.165+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f07741a36c0 con 0x7f0774103b90 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.169+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f0764001cb0 con 0x7f0774103b90 2024-09-06T15:05:06.173 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.169+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0764005c90 con 0x7f0774103b90 2024-09-06T15:05:06.174 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.169+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 13) ==== 50132+0+0 (unknown 587831559 0 0) 0x7f0764012290 con 0x7f0774103b90 2024-09-06T15:05:06.174 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.169+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7f076404d300 con 0x7f0774103b90 2024-09-06T15:05:06.174 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.169+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07580050b0 con 0x7f0774103b90 2024-09-06T15:05:06.177 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.173+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f0764018610 con 0x7f0774103b90 2024-09-06T15:05:06.347 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.341+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}) -- 0x7f0758000bc0 con 0x7f076003eac0 2024-09-06T15:05:06.361 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.357+0000 7f076a7fc640 1 -- 172.21.15.190:0/1737734693 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (unknown 0 0 325935098) 0x7f0758000bc0 con 0x7f076003eac0 2024-09-06T15:05:06.362 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled mgr update... 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 >> v1:172.21.15.189:6800/4002094494 conn(0x7f076003eac0 legacy=0x7f0760040f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 >> v1:172.21.15.190:6789/0 conn(0x7f0774103b90 legacy=0x7f0774197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 shutdown_connections 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 >> 172.21.15.190:0/1737734693 conn(0x7f07740fc4c0 msgr2=0x7f077410cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 shutdown_connections 2024-09-06T15:05:06.364 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:05:06.361+0000 7f077b39d640 1 -- 172.21.15.190:0/1737734693 wait complete. 2024-09-06T15:05:06.882 DEBUG:teuthology.orchestra.run.smithi190:mgr.x> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.x.service 2024-09-06T15:05:06.924 DEBUG:tasks.cephadm:set 0 configs 2024-09-06T15:05:06.924 INFO:tasks.cephadm:Deploying OSDs... 2024-09-06T15:05:06.925 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:05:06.925 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-06T15:05:06.931 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-06T15:05:06.931 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-06 14:55:49.423999025 +0000 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-06 14:55:49.176001235 +0000 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-06 14:55:49.176001235 +0000 2024-09-06T15:05:06.978 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-06T15:05:06.979 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-06T15:05:07.033 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-06T15:05:07.033 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-06T15:05:07.033 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000457403 s, 1.1 MB/s 2024-09-06T15:05:07.035 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-06T15:05:07.088 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-06T15:05:07.141 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-06T15:05:07.141 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-06 14:55:49.927994536 +0000 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-06 14:55:49.691996639 +0000 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-06 14:55:49.691996639 +0000 2024-09-06T15:05:07.142 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-06T15:05:07.142 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-06T15:05:07.196 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-06T15:05:07.196 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-06T15:05:07.197 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000349097 s, 1.5 MB/s 2024-09-06T15:05:07.198 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-06T15:05:07.246 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-06T15:05:07.293 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-06T15:05:07.293 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.293 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-06T15:05:07.294 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.294 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-06 14:55:50.407990260 +0000 2024-09-06T15:05:07.294 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-06 14:55:50.167992397 +0000 2024-09-06T15:05:07.294 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-06 14:55:50.167992397 +0000 2024-09-06T15:05:07.294 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-06T15:05:07.295 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[29727]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:07 smithi189 bash[22757]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.352 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-06T15:05:07.352 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-06T15:05:07.352 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000421093 s, 1.2 MB/s 2024-09-06T15:05:07.352 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-06T15:05:07.403 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-06 14:55:50.891985947 +0000 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-06 14:55:50.651988085 +0000 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-06 14:55:50.651988085 +0000 2024-09-06T15:05:07.450 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-06T15:05:07.450 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-06T15:05:07.503 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-06T15:05:07.503 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-06T15:05:07.504 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000393817 s, 1.3 MB/s 2024-09-06T15:05:07.505 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-06T15:05:07.555 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:05:07.555 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-09-06T15:05:07.561 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-06T15:05:07.561 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-06 14:55:48.459374232 +0000 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-06 14:55:48.187376658 +0000 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-06 14:55:48.187376658 +0000 2024-09-06T15:05:07.608 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-06T15:05:07.609 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-06T15:05:07.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: cluster 2024-09-06T15:05:06.122302+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:07.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.362350+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.364060+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.367192+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.368817+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.379428+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.382549+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.387252+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T15:05:07.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.391832+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:07.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.631 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:07 smithi190 bash[24979]: audit 2024-09-06T15:05:06.393745+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:07.643 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-06T15:05:07.643 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-06T15:05:07.643 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000444185 s, 1.2 MB/s 2024-09-06T15:05:07.644 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-06T15:05:07.695 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-09-06T15:05:07.739 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-06 14:55:48.923370094 +0000 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-06 14:55:48.691372163 +0000 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-06 14:55:48.691372163 +0000 2024-09-06T15:05:07.740 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-06T15:05:07.740 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-06T15:05:07.794 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-06T15:05:07.794 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-06T15:05:07.794 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000339111 s, 1.5 MB/s 2024-09-06T15:05:07.795 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-06T15:05:07.845 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-06 14:55:49.415365705 +0000 2024-09-06T15:05:07.892 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-06 14:55:49.147368095 +0000 2024-09-06T15:05:07.893 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-06 14:55:49.147368095 +0000 2024-09-06T15:05:07.893 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-06T15:05:07.893 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-06T15:05:07.946 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-06T15:05:07.946 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-06T15:05:07.946 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000330669 s, 1.5 MB/s 2024-09-06T15:05:07.947 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-06T15:05:07.996 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-09-06T15:05:08.043 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-06T15:05:08.043 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-09-06 14:55:49.939361030 +0000 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-09-06 14:55:49.659363527 +0000 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-09-06 14:55:49.659363527 +0000 2024-09-06T15:05:08.044 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-09-06T15:05:08.044 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-06T15:05:08.096 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-09-06T15:05:08.096 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-09-06T15:05:08.096 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000237921 s, 2.2 MB/s 2024-09-06T15:05:08.097 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-06T15:05:08.148 INFO:tasks.cephadm:Deploying osd.0 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-06T15:05:08.148 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:08.268 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:08 smithi190 bash[24979]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:08.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[29727]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: audit 2024-09-06T15:05:06.350968+0000 mgr.y (mgr.14146) 75 : audit [DBG] from='client.24112 v1:172.21.15.190:0/1737734693' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi189=y;smithi190=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:08.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: cephadm 2024-09-06T15:05:06.353929+0000 mgr.y (mgr.14146) 76 : cephadm [INF] Saving service mgr spec with placement smithi189=y;smithi190=x;count:2 2024-09-06T15:05:08.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:08.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:08 smithi189 bash[22757]: cephadm 2024-09-06T15:05:06.395601+0000 mgr.y (mgr.14146) 77 : cephadm [INF] Deploying daemon mgr.x on smithi190 2024-09-06T15:05:09.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:09 smithi189 bash[22757]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:09 smithi189 bash[22757]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:09 smithi189 bash[29727]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:09 smithi189 bash[29727]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:09 smithi190 bash[24979]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:09 smithi190 bash[24979]: cluster 2024-09-06T15:05:08.122750+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.629 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.630 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:09.630 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:09 smithi190 systemd[1]: Started Ceph mgr.x for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[25843]: debug 2024-09-06T15:05:10.365+0000 7feb6cafa640 1 -- 172.21.15.190:0/500751828 <== mon.1 v1:172.21.15.190:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (unknown 3953769339 0 0) 0x5570b655af00 con 0x5570b655d800 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:10.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:10 smithi190 bash[24979]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:10.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[22757]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.418447+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.427050+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.435886+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.444356+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: audit 2024-09-06T15:05:09.502843+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:10.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:10 smithi189 bash[29727]: cluster 2024-09-06T15:05:10.123225+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:12.888 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:05:13.358 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[22757]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.358 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[22757]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.358 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[22757]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:13.358 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[22757]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:13.358 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[29727]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[29727]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[29727]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:13.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:13 smithi189 bash[29727]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:13 smithi190 bash[24979]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:13 smithi190 bash[24979]: cluster 2024-09-06T15:05:12.123632+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:13 smithi190 bash[24979]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:13 smithi190 bash[24979]: audit 2024-09-06T15:05:12.731397+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.491 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.492 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[24979]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.571 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.571 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.571 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.571 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.571 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.572 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[22757]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: cluster 2024-09-06T15:05:14.124117+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.741867+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.749249+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.751181+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.752978+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.761853+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.819021+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.820922+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr services"} : dispatch 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.574 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:15 smithi189 bash[29727]: audit 2024-09-06T15:05:14.822282+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: debug 2024-09-06T15:05:15.485+0000 7feb6f364040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: debug 2024-09-06T15:05:15.485+0000 7feb6f364040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: from .module import Module 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: from .fs.volume import VolumeClient 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:05:15.879 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:05:15.880 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:05:15.880 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: debug 2024-09-06T15:05:15.485+0000 7feb6f364040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:05:15.880 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:15 smithi190 bash[25843]: debug 2024-09-06T15:05:15.485+0000 7feb6f364040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:05:16.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[22757]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[22757]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[22757]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[22757]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[29727]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[29727]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[29727]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:16 smithi189 bash[29727]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.629 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:05:16 smithi190 bash[25843]: debug 2024-09-06T15:05:16.241+0000 7feb6f364040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:16.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:16 smithi190 bash[24979]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:16 smithi190 bash[24979]: cephadm 2024-09-06T15:05:14.818344+0000 mgr.y (mgr.14146) 82 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-06T15:05:16.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:16 smithi190 bash[24979]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:16 smithi190 bash[24979]: cephadm 2024-09-06T15:05:14.823999+0000 mgr.y (mgr.14146) 83 : cephadm [INF] Reconfiguring daemon mgr.y on smithi189 2024-09-06T15:05:16.722 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:05:16.765 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[22757]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:17.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:17 smithi189 bash[29727]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.124484+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.246943+0000 mgr.x (mgr.24118) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: cluster 2024-09-06T15:05:16.268708+0000 mon.a (mon.0) 289 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:05:17.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.270312+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.271007+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.272083+0000 mon.b (mon.1) 7 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:17.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:17 smithi190 bash[24979]: audit 2024-09-06T15:05:16.272669+0000 mon.b (mon.1) 8 : audit [DBG] from='mgr.? v1:172.21.15.190:0/1722410590' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:05:18.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[22757]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:18.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:18 smithi189 bash[29727]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: cluster 2024-09-06T15:05:17.218903+0000 mon.a (mon.0) 290 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: audit 2024-09-06T15:05:17.219146+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:18 smithi190 bash[24979]: cluster 2024-09-06T15:05:18.124979+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[22757]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:19 smithi189 bash[29727]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.481151+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.490389+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.493099+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.495999+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:19.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.497384+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:19.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:19.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:19 smithi190 bash[24979]: audit 2024-09-06T15:05:18.505628+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:20 smithi189 bash[22757]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:20.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:20 smithi189 bash[22757]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:20.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:20 smithi189 bash[29727]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:20.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:20 smithi189 bash[29727]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:20.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:20 smithi190 bash[24979]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:20.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:20 smithi190 bash[24979]: cluster 2024-09-06T15:05:20.125442+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:21.491 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- 172.21.15.189:0/2997879678 >> v1:172.21.15.189:6790/0 conn(0x7fb990102560 legacy=0x7fb990102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- 172.21.15.189:0/2997879678 shutdown_connections 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- 172.21.15.189:0/2997879678 >> 172.21.15.189:0/2997879678 conn(0x7fb9900fde30 msgr2=0x7fb990100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- 172.21.15.189:0/2997879678 shutdown_connections 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- 172.21.15.189:0/2997879678 wait complete. 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 Processor -- start 2024-09-06T15:05:22.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- start start 2024-09-06T15:05:22.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb9901a4bb0 con 0x7fb99010a670 2024-09-06T15:05:22.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb9901a5db0 con 0x7fb9901069e0 2024-09-06T15:05:22.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99789f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb9901a6fb0 con 0x7fb990102560 2024-09-06T15:05:22.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99563b640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fb990102560 0x7fb990076950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:47016/0 (socket says 172.21.15.189:47016) 2024-09-06T15:05:22.633 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb99563b640 1 -- 172.21.15.189:0/3571378333 learned_addr learned my addr 172.21.15.189:0/3571378333 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681685707 0 0) 0x7fb9901a6fb0 con 0x7fb990102560 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb97c003520 con 0x7fb990102560 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956981438 0 0) 0x7fb9901a4bb0 con 0x7fb99010a670 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9901a6fb0 con 0x7fb99010a670 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2705373130 0 0) 0x7fb97c003520 con 0x7fb990102560 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9901a4bb0 con 0x7fb990102560 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb98c0044b0 con 0x7fb990102560 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452806266 0 0) 0x7fb9901a5db0 con 0x7fb9901069e0 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb97c003520 con 0x7fb9901069e0 2024-09-06T15:05:22.634 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1843485726 0 0) 0x7fb9901a6fb0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb9901a5db0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.627+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb988001bb0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 938327140 0 0) 0x7fb9901a5db0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 >> v1:172.21.15.189:6790/0 conn(0x7fb990102560 legacy=0x7fb990076950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 >> v1:172.21.15.190:6789/0 conn(0x7fb9901069e0 legacy=0x7fb99019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9901a8250 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb9901a71e0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb9901a77c0 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fb988003e00 con 0x7fb99010a670 2024-09-06T15:05:22.635 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb988004d00 con 0x7fb99010a670 2024-09-06T15:05:22.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9740050b0 con 0x7fb99010a670 2024-09-06T15:05:22.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 14) ==== 99730+0+0 (unknown 1243783455 0 0) 0x7fb988003990 con 0x7fb99010a670 2024-09-06T15:05:22.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.631+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 983+0+0 (unknown 134537438 0 0) 0x7fb9880928e0 con 0x7fb99010a670 2024-09-06T15:05:22.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.635+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fb9880047c0 con 0x7fb99010a670 2024-09-06T15:05:22.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:05:22.811+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb974000bc0 con 0x7fb97c0781b0 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[22757]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:23.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:23.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:23 smithi189 bash[29727]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: cluster 2024-09-06T15:05:22.125845+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.824727+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.828791+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:23.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:23 smithi190 bash[24979]: audit 2024-09-06T15:05:22.830078+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:24.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:24 smithi189 bash[22757]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:24.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:24 smithi189 bash[22757]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:24.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:24 smithi189 bash[29727]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:24.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:24 smithi189 bash[29727]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:24.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:24 smithi190 bash[24979]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:24.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:24 smithi190 bash[24979]: audit 2024-09-06T15:05:22.817985+0000 mgr.y (mgr.14146) 88 : audit [DBG] from='client.14214 v1:172.21.15.189:0/3571378333' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:25.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:25 smithi189 bash[22757]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:25.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:25 smithi189 bash[22757]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:25.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:25 smithi189 bash[29727]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:25.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:25 smithi189 bash[29727]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:25.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:25 smithi190 bash[24979]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:25.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:25 smithi190 bash[24979]: cluster 2024-09-06T15:05:24.126362+0000 mgr.y (mgr.14146) 89 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:26 smithi189 bash[22757]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:26 smithi189 bash[22757]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:26 smithi189 bash[29727]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:26 smithi189 bash[29727]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:26 smithi190 bash[24979]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:26 smithi190 bash[24979]: cluster 2024-09-06T15:05:26.126890+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:29 smithi189 bash[29727]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:29 smithi189 bash[29727]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:29 smithi189 bash[22757]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:29 smithi189 bash[22757]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:29 smithi190 bash[24979]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:29.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:29 smithi190 bash[24979]: cluster 2024-09-06T15:05:28.127373+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[22757]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:31.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:31 smithi189 bash[29727]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: cluster 2024-09-06T15:05:30.127821+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.119496+0000 mon.a (mon.0) 301 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"} : dispatch 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.122267+0000 mon.a (mon.0) 302 : audit [INF] from='client.? v1:172.21.15.189:0/2269601255' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92afed7-3bbd-4d81-ace9-acfee64fc0c3"}]': finished 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: cluster 2024-09-06T15:05:31.127363+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:31.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:31 smithi190 bash[24979]: audit 2024-09-06T15:05:31.127645+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:05:32.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:32 smithi189 bash[22757]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:32.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:32 smithi189 bash[22757]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:32.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:32 smithi189 bash[29727]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:32.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:32 smithi189 bash[29727]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:32.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:32 smithi190 bash[24979]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:32.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:32 smithi190 bash[24979]: audit 2024-09-06T15:05:31.764674+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? v1:172.21.15.189:0/1604552445' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:05:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:33 smithi189 bash[22757]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:33.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:33 smithi189 bash[22757]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:33 smithi189 bash[29727]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:33 smithi189 bash[29727]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:33.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:33 smithi190 bash[24979]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:33.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:33 smithi190 bash[24979]: cluster 2024-09-06T15:05:32.128223+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:34 smithi189 bash[29727]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:34 smithi189 bash[29727]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:34 smithi189 bash[22757]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:34 smithi189 bash[22757]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:34 smithi190 bash[24979]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:34 smithi190 bash[24979]: cluster 2024-09-06T15:05:34.128768+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:37 smithi189 bash[22757]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:37 smithi189 bash[22757]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:37 smithi189 bash[29727]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:37 smithi189 bash[29727]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:37 smithi190 bash[24979]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:37.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:37 smithi190 bash[24979]: cluster 2024-09-06T15:05:36.129259+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:39 smithi189 bash[22757]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:39 smithi189 bash[22757]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:39 smithi189 bash[29727]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:39 smithi189 bash[29727]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:39 smithi190 bash[24979]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:39 smithi190 bash[24979]: cluster 2024-09-06T15:05:38.129709+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.355 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:41 smithi189 bash[22757]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.355 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:41 smithi189 bash[22757]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.356 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:41 smithi189 bash[29727]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.356 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:41 smithi189 bash[29727]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:41 smithi190 bash[24979]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:41.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:41 smithi190 bash[24979]: cluster 2024-09-06T15:05:40.130157+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.474 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:43 smithi189 bash[22757]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.474 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:43 smithi189 bash[22757]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.474 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:43 smithi189 bash[29727]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.475 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:43 smithi189 bash[29727]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:43 smithi190 bash[24979]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:43.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:43 smithi190 bash[24979]: cluster 2024-09-06T15:05:42.130669+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:44 smithi189 bash[29727]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:44 smithi189 bash[29727]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:44 smithi189 bash[22757]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:44 smithi189 bash[22757]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:44 smithi190 bash[24979]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:44.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:44 smithi190 bash[24979]: cluster 2024-09-06T15:05:44.131083+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:45.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[22757]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:45.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:45 smithi189 bash[29727]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: audit 2024-09-06T15:05:44.429619+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: audit 2024-09-06T15:05:44.431385+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:45.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:45 smithi190 bash[24979]: cephadm 2024-09-06T15:05:44.432650+0000 mgr.y (mgr.14146) 100 : cephadm [INF] Deploying daemon osd.0 on smithi189 2024-09-06T15:05:46.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:46 smithi189 bash[22757]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:46.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:46 smithi189 bash[22757]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:46.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:46 smithi189 bash[29727]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:46.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:46 smithi189 bash[29727]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:46.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:46 smithi190 bash[24979]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:46.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:46 smithi190 bash[24979]: cluster 2024-09-06T15:05:46.131563+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:48.741 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:48.742 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:48.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:49.090 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:49.090 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:49.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[29727]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:49 smithi189 bash[22757]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: cluster 2024-09-06T15:05:48.132048+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:49.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.001437+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:05:49.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.006645+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:49.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:49 smithi190 bash[24979]: audit 2024-09-06T15:05:49.012429+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:51.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:51 smithi189 bash[22757]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:51.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:51 smithi189 bash[22757]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:51.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:51 smithi189 bash[29727]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:51.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:51 smithi189 bash[29727]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:51.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:51 smithi190 bash[24979]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:51.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:51 smithi190 bash[24979]: cluster 2024-09-06T15:05:50.132494+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:53 smithi189 bash[22757]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:53 smithi189 bash[22757]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:53 smithi189 bash[29727]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:53 smithi189 bash[29727]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:53 smithi190 bash[24979]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:53 smithi190 bash[24979]: cluster 2024-09-06T15:05:52.132955+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:55 smithi189 bash[29727]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:55 smithi189 bash[29727]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:55 smithi189 bash[22757]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:55 smithi189 bash[22757]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:55 smithi190 bash[24979]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:55 smithi190 bash[24979]: cluster 2024-09-06T15:05:54.133320+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:56 smithi189 bash[22757]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:56 smithi189 bash[22757]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:56 smithi189 bash[29727]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:56 smithi189 bash[29727]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:56 smithi190 bash[24979]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:56.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:56 smithi190 bash[24979]: cluster 2024-09-06T15:05:56.133842+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:57.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[29727]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:57.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:57 smithi189 bash[22757]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:56.826459+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:56.830822+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.443571+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.444719+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:58.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:57 smithi190 bash[24979]: audit 2024-09-06T15:05:57.452588+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:05:59.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:58 smithi189 bash[22757]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:59.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:58 smithi189 bash[22757]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:59.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:58 smithi189 bash[29727]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:59.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:58 smithi189 bash[29727]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:59.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:58 smithi190 bash[24979]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:05:59.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:58 smithi190 bash[24979]: cluster 2024-09-06T15:05:58.134468+0000 mgr.y (mgr.14146) 107 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:00.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:59 smithi189 bash[22757]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:00.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:05:59 smithi189 bash[22757]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:00.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:59 smithi189 bash[29727]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:00.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:05:59 smithi189 bash[29727]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:00.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:59 smithi190 bash[24979]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:00.222 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:05:59 smithi190 bash[24979]: audit 2024-09-06T15:05:59.313477+0000 mon.a (mon.0) 315 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T15:06:01.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:00 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.251+0000 7fb9867fc640 1 -- 172.21.15.189:0/3571378333 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 1339312000) 0x7fb974000bc0 con 0x7fb97c0781b0 2024-09-06T15:06:01.255 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 0 on host 'smithi189' 2024-09-06T15:06:01.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 >> v1:172.21.15.189:6800/4002094494 conn(0x7fb97c0781b0 legacy=0x7fb97c07a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:01.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 >> v1:172.21.15.189:6789/0 conn(0x7fb99010a670 legacy=0x7fb9901a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:01.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 shutdown_connections 2024-09-06T15:06:01.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 >> 172.21.15.189:0/3571378333 conn(0x7fb9900fde30 msgr2=0x7fb99010cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:01.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 shutdown_connections 2024-09-06T15:06:01.258 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:01.255+0000 7fb99789f640 1 -- 172.21.15.189:0/3571378333 wait complete. 2024-09-06T15:06:01.273 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.274 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.843017+0000 mon.a (mon.0) 316 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: cluster 2024-09-06T15:05:59.846594+0000 mon.a (mon.0) 317 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.846882+0000 mon.a (mon.0) 318 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: audit 2024-09-06T15:05:59.847105+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.275 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:00 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.134883+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:01.887 DEBUG:teuthology.orchestra.run.smithi189:osd.0> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.0.service 2024-09-06T15:06:01.890 INFO:tasks.cephadm:Deploying osd.1 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-06T15:06:01.890 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:02.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:01 smithi190 bash[24979]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:02.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[22757]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.845458+0000 mon.a (mon.0) 320 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:02.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.850848+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.852981+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:00.869498+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.239341+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.248563+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.254432+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:02.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:02.356 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:01 smithi189 bash[29727]: audit 2024-09-06T15:06:01.339218+0000 mon.a (mon.0) 327 : audit [INF] from='osd.0 v1:172.21.15.189:6801/775653131' entity='osd.0' 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.130 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:02 smithi190 bash[24979]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[22757]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.299939+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:00.300072+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: audit 2024-09-06T15:06:01.861689+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.135130+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.346710+0000 mon.a (mon.0) 329 : cluster [INF] osd.0 v1:172.21.15.189:6801/775653131 boot 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: cluster 2024-09-06T15:06:02.346821+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-06T15:06:03.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:03.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:02 smithi189 bash[29727]: audit 2024-09-06T15:06:02.347404+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:06:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[22757]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[22757]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[22757]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:04.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[22757]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[29727]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[29727]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[29727]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:04.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:04 smithi189 bash[29727]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:04 smithi190 bash[24979]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:04 smithi190 bash[24979]: cluster 2024-09-06T15:06:03.348239+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-06T15:06:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:04 smithi190 bash[24979]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:04 smithi190 bash[24979]: cluster 2024-09-06T15:06:04.135650+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:06.302 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:06:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:07 smithi189 bash[22757]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:07 smithi189 bash[22757]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:07 smithi189 bash[29727]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:07 smithi189 bash[29727]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:07 smithi190 bash[24979]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:07 smithi190 bash[24979]: cluster 2024-09-06T15:06:06.136144+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:09 smithi189 bash[22757]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:09 smithi189 bash[22757]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:09 smithi189 bash[29727]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:09 smithi189 bash[29727]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:09 smithi190 bash[24979]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:09.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:09 smithi190 bash[24979]: cluster 2024-09-06T15:06:08.136660+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.025 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:06:11.061 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-06T15:06:11.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:11 smithi189 bash[22757]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:11 smithi189 bash[22757]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:11 smithi189 bash[29727]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:11 smithi189 bash[29727]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:11 smithi190 bash[24979]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:11.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:11 smithi190 bash[24979]: cluster 2024-09-06T15:06:10.137004+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:13 smithi189 bash[22757]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:13 smithi189 bash[22757]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:13 smithi189 bash[29727]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:13 smithi189 bash[29727]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:13 smithi190 bash[24979]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:13.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:13 smithi190 bash[24979]: cluster 2024-09-06T15:06:12.137394+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[22757]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:14 smithi189 bash[29727]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cephadm 2024-09-06T15:06:13.590885+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.597348+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.604444+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.606810+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cephadm 2024-09-06T15:06:13.607959+0000 mgr.y (mgr.14146) 116 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 16241M 2024-09-06T15:06:14.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.615756+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.621096+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.622314+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: audit 2024-09-06T15:06:13.631132+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:14.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:14 smithi190 bash[24979]: cluster 2024-09-06T15:06:14.137792+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:16.051 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/515574242 >> v1:172.21.15.189:6789/0 conn(0x7f1a58104760 legacy=0x7f1a58104b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/515574242 shutdown_connections 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/515574242 >> 172.21.15.189:0/515574242 conn(0x7f1a58100030 msgr2=0x7f1a58102470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/515574242 shutdown_connections 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/515574242 wait complete. 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 Processor -- start 2024-09-06T15:06:17.273 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- start start 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1a581a4cc0 con 0x7f1a58108be0 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1a581a5ea0 con 0x7f1a58104760 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1a581a7080 con 0x7f1a5810c870 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a5d91f640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1a58108be0 0x7f1a5819fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49710/0 (socket says 172.21.15.189:49710) 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a5d91f640 1 -- 172.21.15.189:0/3572114684 learned_addr learned my addr 172.21.15.189:0/3572114684 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236147493 0 0) 0x7f1a581a7080 con 0x7f1a5810c870 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a44003520 con 0x7f1a5810c870 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412534081 0 0) 0x7f1a581a4cc0 con 0x7f1a58108be0 2024-09-06T15:06:17.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a581a7080 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726713680 0 0) 0x7f1a581a5ea0 con 0x7f1a58104760 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a581a4cc0 con 0x7f1a58104760 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2641445399 0 0) 0x7f1a581a7080 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a581a5ea0 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 153713397 0 0) 0x7f1a44003520 con 0x7f1a5810c870 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a581a7080 con 0x7f1a5810c870 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1a480018f0 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1a540018b0 con 0x7f1a5810c870 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2428985622 0 0) 0x7f1a581a5ea0 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 >> v1:172.21.15.189:6790/0 conn(0x7f1a5810c870 legacy=0x7f1a581a35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 >> v1:172.21.15.190:6789/0 conn(0x7f1a58104760 legacy=0x7f1a58199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581a8260 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581a72b0 con 0x7f1a58108be0 2024-09-06T15:06:17.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a581a78e0 con 0x7f1a58108be0 2024-09-06T15:06:17.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1a48003a80 con 0x7f1a58108be0 2024-09-06T15:06:17.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1a48005aa0 con 0x7f1a58108be0 2024-09-06T15:06:17.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.271+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3c0050b0 con 0x7f1a58108be0 2024-09-06T15:06:17.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.275+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 14) ==== 99730+0+0 (unknown 1243783455 0 0) 0x7f1a48003610 con 0x7f1a58108be0 2024-09-06T15:06:17.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.275+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1455+0+0 (unknown 2212368902 0 0) 0x7f1a480938a0 con 0x7f1a58108be0 2024-09-06T15:06:17.281 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.279+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f1a4805dbd0 con 0x7f1a58108be0 2024-09-06T15:06:17.446 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:17.443+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1a3c000bc0 con 0x7f1a44078240 2024-09-06T15:06:17.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:17 smithi189 bash[22757]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:17.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:17 smithi189 bash[22757]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:17.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:17 smithi189 bash[29727]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:17.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:17 smithi189 bash[29727]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:17.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:17 smithi190 bash[24979]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:17.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:17 smithi190 bash[24979]: cluster 2024-09-06T15:06:16.138276+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:18.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[22757]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:18.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:18 smithi189 bash[29727]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:18.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.452662+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:06:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.457492+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:06:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:18.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:18 smithi190 bash[24979]: audit 2024-09-06T15:06:17.458607+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[22757]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[22757]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[22757]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[22757]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[29727]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[29727]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[29727]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:19.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:19 smithi189 bash[29727]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:19.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:19 smithi190 bash[24979]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:19 smithi190 bash[24979]: audit 2024-09-06T15:06:17.450171+0000 mgr.y (mgr.14146) 119 : audit [DBG] from='client.14241 v1:172.21.15.189:0/3572114684' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:19.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:19 smithi190 bash[24979]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:19.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:19 smithi190 bash[24979]: cluster 2024-09-06T15:06:18.138929+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:20 smithi189 bash[22757]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:20 smithi189 bash[22757]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:20 smithi189 bash[29727]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:20 smithi189 bash[29727]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:20 smithi190 bash[24979]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:20.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:20 smithi190 bash[24979]: cluster 2024-09-06T15:06:20.139546+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.475 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:23 smithi189 bash[22757]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.475 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:23 smithi189 bash[22757]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.476 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:23 smithi189 bash[29727]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.476 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:23 smithi189 bash[29727]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:23 smithi190 bash[24979]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:23.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:23 smithi190 bash[24979]: cluster 2024-09-06T15:06:22.140173+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:25 smithi189 bash[22757]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:25 smithi189 bash[22757]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:25 smithi189 bash[29727]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:25 smithi189 bash[29727]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:25 smithi190 bash[24979]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:25.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:25 smithi190 bash[24979]: cluster 2024-09-06T15:06:24.140757+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[22757]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:26.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:26 smithi189 bash[29727]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:26.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.899799+0000 mon.c (mon.2) 5 : audit [INF] from='client.? v1:172.21.15.189:0/1337337390' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.900372+0000 mon.a (mon.0) 343 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"} : dispatch 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.903393+0000 mon.a (mon.0) 344 : audit [INF] from='client.24155 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c5618ea-0301-4c3b-b1be-b5f13141d301"}]': finished 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: cluster 2024-09-06T15:06:25.910068+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:26.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:26 smithi190 bash[24979]: audit 2024-09-06T15:06:25.910323+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[29727]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[29727]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[29727]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[29727]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[22757]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[22757]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[22757]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:27.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:27 smithi189 bash[22757]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:27.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:27 smithi190 bash[24979]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:27 smithi190 bash[24979]: cluster 2024-09-06T15:06:26.141212+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:27.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:27 smithi190 bash[24979]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:27.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:27 smithi190 bash[24979]: audit 2024-09-06T15:06:26.552796+0000 mon.c (mon.2) 6 : audit [DBG] from='client.? v1:172.21.15.189:0/1616419314' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:06:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:28 smithi189 bash[29727]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:28 smithi189 bash[29727]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:28.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:28 smithi189 bash[22757]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:28.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:28 smithi189 bash[22757]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:28.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:28 smithi190 bash[24979]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:28.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:28 smithi190 bash[24979]: cluster 2024-09-06T15:06:28.141687+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:31 smithi189 bash[29727]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:31 smithi189 bash[29727]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:31 smithi189 bash[22757]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:31 smithi189 bash[22757]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:31 smithi190 bash[24979]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:31.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:31 smithi190 bash[24979]: cluster 2024-09-06T15:06:30.142197+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:33 smithi189 bash[22757]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:33 smithi189 bash[22757]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:33 smithi189 bash[29727]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:33 smithi189 bash[29727]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:33 smithi190 bash[24979]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:33.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:33 smithi190 bash[24979]: cluster 2024-09-06T15:06:32.142816+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:35 smithi189 bash[22757]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:35 smithi189 bash[22757]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:35 smithi189 bash[29727]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:35 smithi189 bash[29727]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:35 smithi190 bash[24979]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:35 smithi190 bash[24979]: cluster 2024-09-06T15:06:34.143384+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:36 smithi189 bash[22757]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:36 smithi189 bash[22757]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:36 smithi189 bash[29727]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:36 smithi189 bash[29727]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:36 smithi190 bash[24979]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:36.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:36 smithi190 bash[24979]: cluster 2024-09-06T15:06:36.143884+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[22757]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:39.551 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:39 smithi189 bash[29727]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:39.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: cluster 2024-09-06T15:06:38.144307+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: audit 2024-09-06T15:06:39.035367+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T15:06:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:39.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:39 smithi190 bash[24979]: audit 2024-09-06T15:06:39.037052+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:40.564 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:40 smithi189 bash[29727]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:40.564 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:40 smithi189 bash[29727]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:40.565 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:40 smithi189 bash[22757]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:40.565 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:40 smithi189 bash[22757]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:40 smithi190 bash[24979]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:40 smithi190 bash[24979]: cephadm 2024-09-06T15:06:39.038523+0000 mgr.y (mgr.14146) 131 : cephadm [INF] Deploying daemon osd.1 on smithi189 2024-09-06T15:06:41.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:41 smithi189 bash[22757]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:41.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:41 smithi189 bash[22757]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:41.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:41 smithi189 bash[29727]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:41.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:41 smithi189 bash[29727]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:41.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:41 smithi190 bash[24979]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:41.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:41 smithi190 bash[24979]: cluster 2024-09-06T15:06:40.144745+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:42 smithi189 bash[22757]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.550 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:42 smithi189 bash[22757]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:42 smithi189 bash[29727]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.550 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:42 smithi189 bash[29727]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:42 smithi190 bash[24979]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:42.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:42 smithi190 bash[24979]: cluster 2024-09-06T15:06:42.145246+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:43.399 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.399 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.399 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.709 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.710 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.710 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:43.710 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[22757]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:43 smithi189 bash[29727]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.657999+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:44.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.661876+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:43 smithi190 bash[24979]: audit 2024-09-06T15:06:43.667538+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:44.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:44 smithi189 bash[29727]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:44.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:44 smithi189 bash[29727]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:44.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:44 smithi189 bash[22757]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:44.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:44 smithi189 bash[22757]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:45.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:44 smithi190 bash[24979]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:45.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:44 smithi190 bash[24979]: cluster 2024-09-06T15:06:44.145606+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:47 smithi189 bash[22757]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:47 smithi189 bash[22757]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:47 smithi189 bash[29727]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:47 smithi189 bash[29727]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:47 smithi190 bash[24979]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:47.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:47 smithi190 bash[24979]: cluster 2024-09-06T15:06:46.146163+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:49 smithi189 bash[22757]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:49 smithi189 bash[22757]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:49 smithi189 bash[29727]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:49 smithi189 bash[29727]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:49 smithi190 bash[24979]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:49.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:49 smithi190 bash[24979]: cluster 2024-09-06T15:06:48.146865+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.064 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[29727]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.065 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.066 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:50 smithi189 bash[22757]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:49.996295+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.000727+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.001749+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.002384+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: audit 2024-09-06T15:06:50.007128+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:50 smithi190 bash[24979]: cluster 2024-09-06T15:06:50.147390+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.581 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[22757]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.581 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[22757]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.581 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[22757]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:53.581 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[22757]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[29727]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[29727]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[29727]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:53.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:53 smithi189 bash[29727]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:53 smithi190 bash[24979]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:53 smithi190 bash[24979]: cluster 2024-09-06T15:06:52.147853+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:53 smithi190 bash[24979]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:53.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:53 smithi190 bash[24979]: audit 2024-09-06T15:06:52.601994+0000 mon.a (mon.0) 357 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T15:06:54.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.046+0000 7f1a4f7fe640 1 -- 172.21.15.189:0/3572114684 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 331458868) 0x7f1a3c000bc0 con 0x7f1a44078240 2024-09-06T15:06:54.049 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 1 on host 'smithi189' 2024-09-06T15:06:54.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 >> v1:172.21.15.189:6800/4002094494 conn(0x7f1a44078240 legacy=0x7f1a4407a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 >> v1:172.21.15.189:6789/0 conn(0x7f1a58108be0 legacy=0x7f1a5819fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 shutdown_connections 2024-09-06T15:06:54.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 >> 172.21.15.189:0/3572114684 conn(0x7f1a58100030 msgr2=0x7f1a5810ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:54.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 shutdown_connections 2024-09-06T15:06:54.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:06:54.050+0000 7f1a60384640 1 -- 172.21.15.189:0/3572114684 wait complete. 2024-09-06T15:06:54.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.340 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.341 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.341 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.341 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.341 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.341 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[22757]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:54 smithi189 bash[29727]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.203055+0000 mon.a (mon.0) 358 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.208159+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.209057+0000 mon.a (mon.0) 360 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:06:54.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:53.209642+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.029619+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.036621+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.044823+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:54.148161+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v99: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.204859+0000 mon.a (mon.0) 365 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: cluster 2024-09-06T15:06:54.209083+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-06T15:06:54.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:54 smithi190 bash[24979]: audit 2024-09-06T15:06:54.210304+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:54.681 DEBUG:teuthology.orchestra.run.smithi189:osd.1> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.1.service 2024-09-06T15:06:54.684 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-06T15:06:54.684 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[22757]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:55 smithi189 bash[29727]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:54.222983+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:54.642130+0000 mon.a (mon.0) 369 : audit [INF] from='osd.1 v1:172.21.15.189:6805/2081655191' entity='osd.1' 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:55.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:55 smithi190 bash[24979]: audit 2024-09-06T15:06:55.214304+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[22757]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:56.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:56 smithi189 bash[29727]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:56.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.550610+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:06:56.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:53.550759+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:55.652096+0000 mon.a (mon.0) 371 : cluster [INF] osd.1 v1:172.21.15.189:6805/2081655191 boot 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:55.652209+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: audit 2024-09-06T15:06:55.652613+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:56.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:56 smithi190 bash[24979]: cluster 2024-09-06T15:06:56.148603+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T15:06:58.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[22757]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[22757]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[22757]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[22757]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[29727]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[29727]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[29727]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:06:58 smithi189 bash[29727]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:58 smithi190 bash[24979]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:58 smithi190 bash[24979]: cluster 2024-09-06T15:06:57.282500+0000 mon.a (mon.0) 374 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-06T15:06:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:58 smithi190 bash[24979]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:06:58 smithi190 bash[24979]: cluster 2024-09-06T15:06:58.149089+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:06:59.134 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:07:01.301 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:01 smithi189 bash[22757]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:01.301 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:01 smithi189 bash[22757]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:01.302 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:01 smithi189 bash[29727]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:01.302 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:01 smithi189 bash[29727]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:01.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:01 smithi190 bash[24979]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:01.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:01 smithi190 bash[24979]: cluster 2024-09-06T15:07:00.149574+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:03 smithi189 bash[22757]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:03 smithi189 bash[22757]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:03 smithi189 bash[29727]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:03 smithi189 bash[29727]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:03 smithi190 bash[24979]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:03.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:03 smithi190 bash[24979]: cluster 2024-09-06T15:07:02.150073+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:04 smithi189 bash[22757]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:04 smithi189 bash[22757]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:04 smithi189 bash[29727]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:04 smithi189 bash[29727]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:04 smithi190 bash[24979]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:04 smithi190 bash[24979]: cluster 2024-09-06T15:07:04.150672+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:05.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[29727]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:05 smithi189 bash[22757]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: cephadm 2024-09-06T15:07:04.437101+0000 mgr.y (mgr.14146) 145 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.443717+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.452184+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.454550+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.456093+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: cephadm 2024-09-06T15:07:04.457139+0000 mgr.y (mgr.14146) 146 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 8120M 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.462062+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.465958+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.467140+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:05.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:05 smithi190 bash[24979]: audit 2024-09-06T15:07:04.476712+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:06.743 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:07:06.792 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:06 smithi189 bash[22757]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:06.792 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:06 smithi189 bash[22757]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:06.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:06 smithi189 bash[29727]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:06.793 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:06 smithi189 bash[29727]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:06.794 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-06T15:07:06.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:06 smithi190 bash[24979]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:06.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:06 smithi190 bash[24979]: cluster 2024-09-06T15:07:06.151016+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:09 smithi189 bash[22757]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:09 smithi189 bash[22757]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:09 smithi189 bash[29727]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:09 smithi189 bash[29727]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:09 smithi190 bash[24979]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:09.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:09 smithi190 bash[24979]: cluster 2024-09-06T15:07:08.151480+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.546 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:07:11.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:11 smithi189 bash[22757]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:11 smithi189 bash[22757]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:11 smithi189 bash[29727]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:11 smithi189 bash[29727]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:11 smithi190 bash[24979]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:11.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:11 smithi190 bash[24979]: cluster 2024-09-06T15:07:10.152011+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:12 smithi189 bash[22757]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:12 smithi189 bash[22757]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:12 smithi189 bash[29727]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:12 smithi189 bash[29727]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:12 smithi190 bash[24979]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:12 smithi190 bash[24979]: cluster 2024-09-06T15:07:12.152627+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:12.693 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/1353942815 >> v1:172.21.15.189:6789/0 conn(0x7ff8881069e0 legacy=0x7ff888108dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/1353942815 shutdown_connections 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/1353942815 >> 172.21.15.189:0/1353942815 conn(0x7ff8880fde30 msgr2=0x7ff888100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/1353942815 shutdown_connections 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/1353942815 wait complete. 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 Processor -- start 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- start start 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8881a2b10 con 0x7ff8881069e0 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8881a3cf0 con 0x7ff888102560 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff8881a4ed0 con 0x7ff88810a670 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88ca37640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff8881069e0 0x7ff88819dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39002/0 (socket says 172.21.15.189:39002) 2024-09-06T15:07:12.694 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88ca37640 1 -- 172.21.15.189:0/3639790019 learned_addr learned my addr 172.21.15.189:0/3639790019 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697082485 0 0) 0x7ff8881a2b10 con 0x7ff8881069e0 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff874005020 con 0x7ff8881069e0 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982906371 0 0) 0x7ff8881a4ed0 con 0x7ff88810a670 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8881a2b10 con 0x7ff88810a670 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3643230272 0 0) 0x7ff874005020 con 0x7ff8881069e0 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8881a4ed0 con 0x7ff8881069e0 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257813210 0 0) 0x7ff8881a3cf0 con 0x7ff888102560 2024-09-06T15:07:12.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff874005020 con 0x7ff888102560 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff8780015b0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3996690020 0 0) 0x7ff8881a2b10 con 0x7ff88810a670 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8881a3cf0 con 0x7ff88810a670 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff880001b70 con 0x7ff88810a670 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 129151899 0 0) 0x7ff8881a4ed0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 >> v1:172.21.15.189:6790/0 conn(0x7ff88810a670 legacy=0x7ff8881a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 >> v1:172.21.15.190:6789/0 conn(0x7ff888102560 legacy=0x7ff888197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8881a60b0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8881a5100 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8881a56e0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7ff878001ac0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.694+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff878004db0 con 0x7ff8881069e0 2024-09-06T15:07:12.697 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.698+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86c0050b0 con 0x7ff8881069e0 2024-09-06T15:07:12.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.698+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 14) ==== 99730+0+0 (unknown 1243783455 0 0) 0x7ff878003680 con 0x7ff8881069e0 2024-09-06T15:07:12.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.698+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 1747+0+0 (unknown 2973732797 0 0) 0x7ff878093c40 con 0x7ff8881069e0 2024-09-06T15:07:12.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.702+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ff87805de40 con 0x7ff8881069e0 2024-09-06T15:07:12.870 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:12.870+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff86c000bc0 con 0x7ff8740782d0 2024-09-06T15:07:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:13.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[22757]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:13.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:13.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:13 smithi189 bash[29727]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:13.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.874315+0000 mgr.y (mgr.14146) 151 : audit [DBG] from='client.14268 v1:172.21.15.189:0/3639790019' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:13.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.876755+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:07:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.881777+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:07:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:13.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:13 smithi190 bash[24979]: audit 2024-09-06T15:07:12.882878+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:14 smithi189 bash[22757]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:14 smithi189 bash[22757]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:14 smithi189 bash[29727]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:14 smithi189 bash[29727]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:14.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:14 smithi190 bash[24979]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:14.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:14 smithi190 bash[24979]: cluster 2024-09-06T15:07:14.153089+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:17 smithi189 bash[29727]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:17 smithi189 bash[29727]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:17 smithi189 bash[22757]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:17 smithi189 bash[22757]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:17 smithi190 bash[24979]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:17.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:17 smithi190 bash[24979]: cluster 2024-09-06T15:07:16.153577+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:19 smithi189 bash[22757]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:19 smithi189 bash[22757]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:19 smithi189 bash[29727]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:19 smithi189 bash[29727]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:19 smithi190 bash[24979]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:19.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:19 smithi190 bash[24979]: cluster 2024-09-06T15:07:18.154083+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v114: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.512 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:20 smithi189 bash[22757]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.512 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:20 smithi189 bash[22757]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:20 smithi189 bash[29727]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:20 smithi189 bash[29727]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:20 smithi190 bash[24979]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:20.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:20 smithi190 bash[24979]: cluster 2024-09-06T15:07:20.154600+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:21.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[22757]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:21.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:21 smithi189 bash[29727]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:21.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.292326+0000 mon.a (mon.0) 386 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"} : dispatch 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.295255+0000 mon.a (mon.0) 387 : audit [INF] from='client.? v1:172.21.15.189:0/3629941059' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f49d03c-eab1-4700-bea3-7a6c5c80a1f9"}]': finished 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: cluster 2024-09-06T15:07:21.300655+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:21.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:21 smithi190 bash[24979]: audit 2024-09-06T15:07:21.300877+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[22757]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[22757]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[22757]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[22757]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[29727]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[29727]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[29727]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:22 smithi189 bash[29727]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:22.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:22 smithi190 bash[24979]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:22 smithi190 bash[24979]: audit 2024-09-06T15:07:21.916043+0000 mon.a (mon.0) 390 : audit [DBG] from='client.? v1:172.21.15.189:0/4143330987' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:07:22.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:22 smithi190 bash[24979]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:22.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:22 smithi190 bash[24979]: cluster 2024-09-06T15:07:22.155199+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v117: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.560 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:25 smithi189 bash[22757]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.560 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:25 smithi189 bash[22757]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:25 smithi189 bash[29727]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:25 smithi189 bash[29727]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:25 smithi190 bash[24979]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:25.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:25 smithi190 bash[24979]: cluster 2024-09-06T15:07:24.155830+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:27 smithi189 bash[22757]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:27 smithi189 bash[22757]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:27 smithi189 bash[29727]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:27 smithi189 bash[29727]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:27 smithi190 bash[24979]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:27.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:27 smithi190 bash[24979]: cluster 2024-09-06T15:07:26.156354+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v119: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:28 smithi189 bash[22757]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:28 smithi189 bash[22757]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:28 smithi189 bash[29727]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:28 smithi189 bash[29727]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:28 smithi190 bash[24979]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:28.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:28 smithi190 bash[24979]: cluster 2024-09-06T15:07:28.156856+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:31 smithi189 bash[29727]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:31 smithi189 bash[29727]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:31 smithi189 bash[22757]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:31 smithi189 bash[22757]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:31 smithi190 bash[24979]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:31.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:31 smithi190 bash[24979]: cluster 2024-09-06T15:07:30.157350+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:33 smithi189 bash[22757]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:33 smithi189 bash[22757]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:33 smithi189 bash[29727]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:33 smithi189 bash[29727]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:33 smithi190 bash[24979]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:33.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:33 smithi190 bash[24979]: cluster 2024-09-06T15:07:32.157687+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:34 smithi189 bash[29727]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:34 smithi189 bash[29727]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:34 smithi189 bash[22757]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:34 smithi189 bash[22757]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:34 smithi190 bash[24979]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:34 smithi190 bash[24979]: cluster 2024-09-06T15:07:34.158174+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:35.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[22757]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:35.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:35 smithi189 bash[29727]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: audit 2024-09-06T15:07:34.642959+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T15:07:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: audit 2024-09-06T15:07:34.644304+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:35.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:35.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:35 smithi190 bash[24979]: cephadm 2024-09-06T15:07:34.645514+0000 mgr.y (mgr.14146) 163 : cephadm [INF] Deploying daemon osd.2 on smithi189 2024-09-06T15:07:36.416 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:36 smithi189 bash[29727]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:36.416 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:36 smithi189 bash[29727]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:36.416 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:36 smithi189 bash[22757]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:36.416 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:36 smithi189 bash[22757]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:36 smithi190 bash[24979]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:36 smithi190 bash[24979]: cluster 2024-09-06T15:07:36.158669+0000 mgr.y (mgr.14146) 164 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.090 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:38 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.091 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:07:38 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.091 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:07:38 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.091 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:07:38 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:38 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.351 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:07:39 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.352 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:07:39 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.352 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:07:39 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:39 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:39 smithi189 bash[22757]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:39 smithi189 bash[22757]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:39 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:07:39.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:39 smithi189 bash[29727]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:39 smithi189 bash[29727]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:39 smithi190 bash[24979]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:39.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:39 smithi190 bash[24979]: cluster 2024-09-06T15:07:38.159108+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[29727]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:40 smithi189 bash[22757]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.249415+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.255676+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: audit 2024-09-06T15:07:39.262114+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:40.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:40.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:40 smithi190 bash[24979]: cluster 2024-09-06T15:07:40.159656+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:43 smithi189 bash[22757]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:43 smithi189 bash[22757]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:43 smithi189 bash[29727]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:43 smithi189 bash[29727]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:43 smithi190 bash[24979]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:43 smithi190 bash[24979]: cluster 2024-09-06T15:07:42.160186+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.538 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:44 smithi189 bash[22757]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.538 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:44 smithi189 bash[22757]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:44 smithi189 bash[29727]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:44 smithi189 bash[29727]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:44 smithi190 bash[24979]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:44.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:44 smithi190 bash[24979]: cluster 2024-09-06T15:07:44.160664+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[22757]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:47 smithi189 bash[29727]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.016553+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.022855+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: cluster 2024-09-06T15:07:46.161147+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.624554+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.625639+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:47.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:47 smithi190 bash[24979]: audit 2024-09-06T15:07:46.634409+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:48.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:48 smithi189 bash[22757]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:48.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:48 smithi189 bash[22757]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:48.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:48 smithi189 bash[29727]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:48.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:48 smithi189 bash[29727]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:48.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:48 smithi190 bash[24979]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:48.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:48 smithi190 bash[24979]: audit 2024-09-06T15:07:47.718973+0000 mon.a (mon.0) 401 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T15:07:49.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.324 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.325 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:49 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.034878+0000 mon.a (mon.0) 402 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T15:07:49.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.039961+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-06T15:07:49.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.040449+0000 mon.a (mon.0) 404 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:07:49.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: audit 2024-09-06T15:07:48.040754+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:49.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:49 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.161692+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v131: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:49.818 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.818+0000 7ff87e7fc640 1 -- 172.21.15.189:0/3639790019 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 4160723688) 0x7ff86c000bc0 con 0x7ff8740782d0 2024-09-06T15:07:49.818 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 >> v1:172.21.15.189:6800/4002094494 conn(0x7ff8740782d0 legacy=0x7ff87407a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 >> v1:172.21.15.189:6789/0 conn(0x7ff8881069e0 legacy=0x7ff88819dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 shutdown_connections 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 >> 172.21.15.189:0/3639790019 conn(0x7ff8880fde30 msgr2=0x7ff88810cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 shutdown_connections 2024-09-06T15:07:49.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:07:49.822+0000 7ff88f49c640 1 -- 172.21.15.189:0/3639790019 wait complete. 2024-09-06T15:07:50.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[29727]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.104 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:50 smithi189 bash[22757]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.036808+0000 mon.a (mon.0) 406 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: cluster 2024-09-06T15:07:49.041454+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.042794+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.052104+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.566900+0000 mon.a (mon.0) 410 : audit [INF] from='osd.2 v1:172.21.15.189:6809/2943648838' entity='osd.2' 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.798264+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:07:50.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.807888+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:50 smithi190 bash[24979]: audit 2024-09-06T15:07:49.817412+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:50.388 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.2.service 2024-09-06T15:07:50.392 INFO:tasks.cephadm:Deploying osd.3 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-06T15:07:50.392 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-06T15:07:51.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[22757]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:51 smithi189 bash[29727]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.725054+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:07:51.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:48.725145+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: audit 2024-09-06T15:07:50.054191+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.162059+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.575143+0000 mon.a (mon.0) 415 : cluster [INF] osd.2 v1:172.21.15.189:6809/2943648838 boot 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: cluster 2024-09-06T15:07:50.575191+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:51.379 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:51 smithi190 bash[24979]: audit 2024-09-06T15:07:50.575722+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:52.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[22757]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:52.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:52 smithi189 bash[29727]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: cluster 2024-09-06T15:07:51.575018+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: cluster 2024-09-06T15:07:52.162541+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:52.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:52 smithi190 bash[24979]: audit 2024-09-06T15:07:52.500895+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[22757]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:53 smithi189 bash[29727]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: audit 2024-09-06T15:07:52.580481+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: cluster 2024-09-06T15:07:52.587792+0000 mon.a (mon.0) 421 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:53.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:53 smithi190 bash[24979]: audit 2024-09-06T15:07:52.589424+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-06T15:07:54.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.853 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.854 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.855 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.856 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.857 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[22757]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.858 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.860 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.860 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.860 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:54.860 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:54 smithi189 bash[29727]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:54.867 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:07:54.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.582678+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T15:07:54.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: cluster 2024-09-06T15:07:53.588989+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.844614+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943510+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943651+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.943875+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.944000+0000 mon.a (mon.0) 429 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.879 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.986574+0000 mon.a (mon.0) 430 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989143+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989210+0000 mon.b (mon.1) 9 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989367+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:53.989534+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.880 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.043747+0000 mon.b (mon.1) 10 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.080269+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.082771+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083099+0000 mon.c (mon.2) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083286+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.083763+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: audit 2024-09-06T15:07:54.130568+0000 mon.c (mon.2) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T15:07:54.881 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:54.882 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:54 smithi190 bash[24979]: cluster 2024-09-06T15:07:54.162979+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:55.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:55 smithi190 bash[24979]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:55.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:55 smithi190 bash[24979]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:55.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:55 smithi190 bash[24979]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:55.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:55 smithi190 bash[24979]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:56.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[22757]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:56.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[22757]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:56.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[22757]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:56.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[22757]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:56.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[29727]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:56.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[29727]: cluster 2024-09-06T15:07:54.620017+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-09-06T15:07:56.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[29727]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:56.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:55 smithi189 bash[29727]: cluster 2024-09-06T15:07:55.100916+0000 mon.a (mon.0) 439 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-06T15:07:56.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:56 smithi190 bash[24979]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:56.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:56 smithi190 bash[24979]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:57.018 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:56 smithi189 bash[22757]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:57.018 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:56 smithi189 bash[22757]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:57.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:56 smithi189 bash[29727]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:57.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:56 smithi189 bash[29727]: cluster 2024-09-06T15:07:56.163458+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v141: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.220 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:59 smithi189 bash[22757]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.220 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:07:59 smithi189 bash[22757]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:59 smithi189 bash[29727]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:07:59 smithi189 bash[29727]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:59 smithi190 bash[24979]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:07:59 smithi190 bash[24979]: cluster 2024-09-06T15:07:58.164037+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:07:59.785 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:07:59.836 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-06T15:08:00.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:00 smithi189 bash[29727]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:00.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:00 smithi189 bash[29727]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:00.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:00 smithi189 bash[22757]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:00.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:00 smithi189 bash[22757]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:00.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:00 smithi190 bash[24979]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:00.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:00 smithi190 bash[24979]: cluster 2024-09-06T15:08:00.164585+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[22757]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:03 smithi189 bash[29727]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: cluster 2024-09-06T15:08:02.165007+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:03.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.670224+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.679651+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.682580+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.684157+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.685614+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.693689+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.698806+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:03.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.700348+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:03.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:03.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:03 smithi190 bash[24979]: audit 2024-09-06T15:08:02.710208+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[22757]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:04.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:04 smithi189 bash[29727]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cephadm 2024-09-06T15:08:02.662825+0000 mgr.y (mgr.14146) 178 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cephadm 2024-09-06T15:08:02.686804+0000 mgr.y (mgr.14146) 179 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 5413M 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:04.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:04 smithi190 bash[24979]: cluster 2024-09-06T15:08:04.165624+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:05.124 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:08:06.251 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/324184687 >> v1:172.21.15.189:6790/0 conn(0x7f978810a670 legacy=0x7f978810cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:06.251 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/324184687 shutdown_connections 2024-09-06T15:08:06.252 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/324184687 >> 172.21.15.189:0/324184687 conn(0x7f97880fde30 msgr2=0x7f9788100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:06.252 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/324184687 shutdown_connections 2024-09-06T15:08:06.252 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/324184687 wait complete. 2024-09-06T15:08:06.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 Processor -- start 2024-09-06T15:08:06.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- start start 2024-09-06T15:08:06.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f97881a4d60 con 0x7f978810a670 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f97881a5f40 con 0x7f9788102560 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f97881a7120 con 0x7f97881069e0 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977dd9b640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f97881069e0 0x7f978819ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:60920/0 (socket says 172.21.15.189:60920) 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977dd9b640 1 -- 172.21.15.189:0/152220311 learned_addr learned my addr 172.21.15.189:0/152220311 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134896062 0 0) 0x7f97881a7120 con 0x7f97881069e0 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9774003520 con 0x7f97881069e0 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060074091 0 0) 0x7f97881a4d60 con 0x7f978810a670 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97881a7120 con 0x7f978810a670 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 139002433 0 0) 0x7f97881a7120 con 0x7f978810a670 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97881a4d60 con 0x7f978810a670 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2561639860 0 0) 0x7f9774003520 con 0x7f97881069e0 2024-09-06T15:08:06.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97881a7120 con 0x7f97881069e0 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9780001760 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844401943 0 0) 0x7f97881a5f40 con 0x7f9788102560 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9774003520 con 0x7f9788102560 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f97700019b0 con 0x7f97881069e0 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1860853125 0 0) 0x7f97881a4d60 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 >> v1:172.21.15.189:6790/0 conn(0x7f97881069e0 legacy=0x7f978819ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 >> v1:172.21.15.190:6789/0 conn(0x7f9788102560 legacy=0x7f9788109550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97881a8350 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97881a4f90 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f97881a5570 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f97800014a0 con 0x7f978810a670 2024-09-06T15:08:06.255 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9780004ef0 con 0x7f978810a670 2024-09-06T15:08:06.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.254+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97680050b0 con 0x7f978810a670 2024-09-06T15:08:06.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.258+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f9780001cb0 con 0x7f978810a670 2024-09-06T15:08:06.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.258+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 2425+0+0 (unknown 2920871585 0 0) 0x7f97800930d0 con 0x7f978810a670 2024-09-06T15:08:06.260 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.262+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f978005ce90 con 0x7f978810a670 2024-09-06T15:08:06.424 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:06.426+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9768000bc0 con 0x7f97740782e0 2024-09-06T15:08:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[22757]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:07.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:07 smithi189 bash[29727]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: cluster 2024-09-06T15:08:06.166124+0000 mgr.y (mgr.14146) 181 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.431404+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.436512+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:07.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:07 smithi190 bash[24979]: audit 2024-09-06T15:08:06.437529+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[22757]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[22757]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[22757]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[22757]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:08.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[29727]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[29727]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[29727]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:08.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:08 smithi189 bash[29727]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:08.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:08 smithi190 bash[24979]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:08 smithi190 bash[24979]: audit 2024-09-06T15:08:06.428213+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.14304 v1:172.21.15.189:0/152220311' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:08.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:08 smithi190 bash[24979]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:08.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:08 smithi190 bash[24979]: cluster 2024-09-06T15:08:08.166809+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:10 smithi189 bash[22757]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:10 smithi189 bash[22757]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:10 smithi189 bash[29727]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:10 smithi189 bash[29727]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:10 smithi190 bash[24979]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:10.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:10 smithi190 bash[24979]: cluster 2024-09-06T15:08:10.167445+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:12 smithi189 bash[22757]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:12 smithi189 bash[22757]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:12 smithi189 bash[29727]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:12 smithi189 bash[29727]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:12 smithi190 bash[24979]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:12.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:12 smithi190 bash[24979]: cluster 2024-09-06T15:08:12.168103+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:14 smithi189 bash[22757]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:14 smithi189 bash[22757]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:14 smithi189 bash[29727]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:14 smithi189 bash[29727]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:14 smithi190 bash[24979]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:14.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:14 smithi190 bash[24979]: cluster 2024-09-06T15:08:14.168534+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:15.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[22757]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:15 smithi189 bash[29727]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.886444+0000 mon.c (mon.2) 9 : audit [INF] from='client.? v1:172.21.15.189:0/2453496407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.887235+0000 mon.a (mon.0) 452 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"} : dispatch 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.892087+0000 mon.a (mon.0) 453 : audit [INF] from='client.24218 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f"}]': finished 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: cluster 2024-09-06T15:08:14.897190+0000 mon.a (mon.0) 454 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-06T15:08:15.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:15.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:15 smithi190 bash[24979]: audit 2024-09-06T15:08:14.897377+0000 mon.a (mon.0) 455 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[22757]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[22757]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[22757]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[22757]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:16.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[29727]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[29727]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[29727]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:16.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:16 smithi189 bash[29727]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:16.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:16 smithi190 bash[24979]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:16 smithi190 bash[24979]: audit 2024-09-06T15:08:15.496693+0000 mon.c (mon.2) 10 : audit [DBG] from='client.? v1:172.21.15.189:0/1793761089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:08:16.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:16 smithi190 bash[24979]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:16.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:16 smithi190 bash[24979]: cluster 2024-09-06T15:08:16.169123+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:18 smithi189 bash[22757]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:18 smithi189 bash[22757]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:18 smithi189 bash[29727]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:18 smithi189 bash[29727]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:18 smithi190 bash[24979]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:18.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:18 smithi190 bash[24979]: cluster 2024-09-06T15:08:18.169618+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:20 smithi189 bash[22757]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:20 smithi189 bash[22757]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:20 smithi189 bash[29727]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:20 smithi189 bash[29727]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:20 smithi190 bash[24979]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:20.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:20 smithi190 bash[24979]: cluster 2024-09-06T15:08:20.170120+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:22 smithi189 bash[22757]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:22 smithi189 bash[22757]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:22 smithi189 bash[29727]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:22 smithi189 bash[29727]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:22 smithi190 bash[24979]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:22.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:22 smithi190 bash[24979]: cluster 2024-09-06T15:08:22.170757+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:24 smithi189 bash[22757]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:24 smithi189 bash[22757]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:24 smithi189 bash[29727]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:24 smithi189 bash[29727]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:24 smithi190 bash[24979]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:24.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:24 smithi190 bash[24979]: cluster 2024-09-06T15:08:24.171311+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:26 smithi189 bash[22757]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:26 smithi189 bash[22757]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:26 smithi189 bash[29727]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:26 smithi189 bash[29727]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:26 smithi190 bash[24979]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:26.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:26 smithi190 bash[24979]: cluster 2024-09-06T15:08:26.171866+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:28 smithi189 bash[22757]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:28 smithi189 bash[22757]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:28 smithi189 bash[29727]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:28 smithi189 bash[29727]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:28 smithi190 bash[24979]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:28.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:28 smithi190 bash[24979]: cluster 2024-09-06T15:08:28.172485+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:29.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:29.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[22757]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:29.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:29.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:29 smithi189 bash[29727]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:29.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: audit 2024-09-06T15:08:28.483618+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T15:08:29.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: audit 2024-09-06T15:08:28.484902+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:29.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:29.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:29 smithi190 bash[24979]: cephadm 2024-09-06T15:08:28.485951+0000 mgr.y (mgr.14146) 194 : cephadm [INF] Deploying daemon osd.3 on smithi189 2024-09-06T15:08:30.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:30 smithi189 bash[22757]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:30.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:30 smithi189 bash[22757]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:30.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:30 smithi189 bash[29727]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:30.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:30 smithi189 bash[29727]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:30.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:30 smithi190 bash[24979]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:30.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:30 smithi190 bash[24979]: cluster 2024-09-06T15:08:30.172939+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:32 smithi189 bash[22757]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:32 smithi189 bash[22757]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:32 smithi189 bash[29727]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:32 smithi189 bash[29727]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:32 smithi190 bash[24979]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:32 smithi190 bash[24979]: cluster 2024-09-06T15:08:32.173558+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:32.972 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:32.972 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:32.973 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:32.973 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:32.973 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:32.974 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:08:32 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.229 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.230 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.230 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.230 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.230 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.231 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:33 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:08:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:33 smithi189 bash[22757]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:33 smithi189 bash[22757]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:33 smithi189 bash[29727]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:33 smithi189 bash[29727]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:33.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:33 smithi190 bash[24979]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:33.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:33 smithi190 bash[24979]: audit 2024-09-06T15:08:33.273289+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:34.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[22757]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:34.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:34 smithi189 bash[29727]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:34.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: audit 2024-09-06T15:08:33.277299+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: audit 2024-09-06T15:08:33.288167+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:34.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:34 smithi190 bash[24979]: cluster 2024-09-06T15:08:34.174109+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:36 smithi189 bash[22757]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:36 smithi189 bash[22757]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:36 smithi189 bash[29727]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:36 smithi189 bash[29727]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:36 smithi190 bash[24979]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:36 smithi190 bash[24979]: cluster 2024-09-06T15:08:36.174694+0000 mgr.y (mgr.14146) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:38 smithi189 bash[22757]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:38 smithi189 bash[22757]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:38 smithi189 bash[29727]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:38 smithi189 bash[29727]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:38 smithi190 bash[24979]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:38 smithi190 bash[24979]: cluster 2024-09-06T15:08:38.175328+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[22757]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:40 smithi189 bash[29727]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.736120+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.742576+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.743500+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.744232+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: audit 2024-09-06T15:08:39.750819+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:41.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:40 smithi190 bash[24979]: cluster 2024-09-06T15:08:40.175987+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:42.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:41 smithi189 bash[22757]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:42.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:41 smithi189 bash[22757]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:42.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:41 smithi189 bash[29727]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:42.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:41 smithi189 bash[29727]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:42.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:41 smithi190 bash[24979]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:42.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:41 smithi190 bash[24979]: audit 2024-09-06T15:08:41.823393+0000 mon.a (mon.0) 466 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T15:08:43.260 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.261+0000 7f977ffff640 1 -- 172.21.15.189:0/152220311 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 2884269148) 0x7f9768000bc0 con 0x7f97740782e0 2024-09-06T15:08:43.261 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 3 on host 'smithi189' 2024-09-06T15:08:43.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 >> v1:172.21.15.189:6800/4002094494 conn(0x7f97740782e0 legacy=0x7f977407a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:43.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 >> v1:172.21.15.189:6789/0 conn(0x7f978810a670 legacy=0x7f97881a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:43.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 shutdown_connections 2024-09-06T15:08:43.263 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 >> 172.21.15.189:0/152220311 conn(0x7f97880fde30 msgr2=0x7f978810d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:43.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 shutdown_connections 2024-09-06T15:08:43.264 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:08:43.265+0000 7f978cbb8640 1 -- 172.21.15.189:0/152220311 wait complete. 2024-09-06T15:08:43.282 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.282 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.282 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[22757]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.283 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.284 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:42 smithi189 bash[29727]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.875387+0000 mon.a (mon.0) 467 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: cluster 2024-09-06T15:08:41.878435+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.878909+0000 mon.a (mon.0) 469 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:41.879157+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.176530+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:42 smithi190 bash[24979]: audit 2024-09-06T15:08:42.877813+0000 mon.a (mon.0) 471 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-06T15:08:43.847 DEBUG:teuthology.orchestra.run.smithi189:osd.3> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.3.service 2024-09-06T15:08:43.850 INFO:tasks.cephadm:Deploying osd.4 on smithi190 with /dev/vg_nvme/lv_4... 2024-09-06T15:08:43.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-06T15:08:44.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.146 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.147 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[22757]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.148 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:43 smithi189 bash[29727]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.883508+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-09-06T15:08:44.149 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:42.885793+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:42.924583+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.222935+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.250843+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.259842+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:44.150 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:43 smithi190 bash[24979]: audit 2024-09-06T15:08:43.365463+0000 mon.a (mon.0) 478 : audit [INF] from='osd.3 v1:172.21.15.189:6813/3926696354' entity='osd.3' 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[22757]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:44 smithi189 bash[29727]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.865000+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:42.865135+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: audit 2024-09-06T15:08:43.894545+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.177046+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.371119+0000 mon.a (mon.0) 480 : cluster [INF] osd.3 v1:172.21.15.189:6813/3926696354 boot 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: cluster 2024-09-06T15:08:44.371186+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:45.378 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:44 smithi190 bash[24979]: audit 2024-09-06T15:08:44.371553+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:08:46.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:46 smithi190 bash[24979]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:46 smithi190 bash[24979]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:46 smithi190 bash[24979]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:46 smithi190 bash[24979]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:46.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[22757]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[22757]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[22757]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[22757]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[29727]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[29727]: cluster 2024-09-06T15:08:45.376275+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[29727]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:46.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:46 smithi189 bash[29727]: cluster 2024-09-06T15:08:46.177635+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.580 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:08:48.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:48 smithi189 bash[22757]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:48 smithi189 bash[22757]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:48 smithi189 bash[29727]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:48 smithi189 bash[29727]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:48 smithi190 bash[24979]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:48.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:48 smithi190 bash[24979]: cluster 2024-09-06T15:08:48.178224+0000 mgr.y (mgr.14146) 204 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:50 smithi189 bash[22757]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:50 smithi189 bash[22757]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:50 smithi189 bash[29727]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:50 smithi189 bash[29727]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:50 smithi190 bash[24979]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:50.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:50 smithi190 bash[24979]: cluster 2024-09-06T15:08:50.178922+0000 mgr.y (mgr.14146) 205 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.332 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:08:52.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:52 smithi189 bash[22757]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:52 smithi189 bash[22757]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:52 smithi189 bash[29727]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:52 smithi189 bash[29727]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.371 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_4 2024-09-06T15:08:52.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:52 smithi190 bash[24979]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:52.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:52 smithi190 bash[24979]: cluster 2024-09-06T15:08:52.179597+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:54.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[22757]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:53 smithi189 bash[29727]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: cephadm 2024-09-06T15:08:52.650390+0000 mgr.y (mgr.14146) 207 : cephadm [INF] Detected new or changed devices on smithi189 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.659496+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.668623+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.671705+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.673221+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.674506+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.128 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.675888+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: cephadm 2024-09-06T15:08:52.676903+0000 mgr.y (mgr.14146) 208 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 4060M 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.682773+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.687943+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.689439+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:54.129 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:53 smithi190 bash[24979]: audit 2024-09-06T15:08:52.699416+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:08:55.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:54 smithi189 bash[22757]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:55.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:54 smithi189 bash[22757]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:55.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:54 smithi189 bash[29727]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:55.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:54 smithi189 bash[29727]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:55.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:54 smithi190 bash[24979]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:55.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:54 smithi190 bash[24979]: cluster 2024-09-06T15:08:54.180161+0000 mgr.y (mgr.14146) 209 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:56 smithi189 bash[29727]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:56 smithi189 bash[29727]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:56 smithi189 bash[22757]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:56 smithi189 bash[22757]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:56 smithi190 bash[24979]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:56.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:56 smithi190 bash[24979]: cluster 2024-09-06T15:08:56.180722+0000 mgr.y (mgr.14146) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:57.101 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:08:58.292 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.289+0000 7f9b21f67640 1 -- 172.21.15.190:0/1837341804 >> v1:172.21.15.190:6789/0 conn(0x7f9b1c104760 legacy=0x7f9b1c104b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/1837341804 shutdown_connections 2024-09-06T15:08:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/1837341804 >> 172.21.15.190:0/1837341804 conn(0x7f9b1c100030 msgr2=0x7f9b1c102470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/1837341804 shutdown_connections 2024-09-06T15:08:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/1837341804 wait complete. 2024-09-06T15:08:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 Processor -- start 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- start start 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b1c1a4f20 con 0x7f9b1c104760 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b1c1a6100 con 0x7f9b1c108be0 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9b1c1a72e0 con 0x7f9b1c10c870 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b1affd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9b1c108be0 0x7f9b1c1a00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:46744/0 (socket says 172.21.15.190:46744) 2024-09-06T15:08:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b1affd640 1 -- 172.21.15.190:0/2941194952 learned_addr learned my addr 172.21.15.190:0/2941194952 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747148804 0 0) 0x7f9b1c1a6100 con 0x7f9b1c108be0 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b04003520 con 0x7f9b1c108be0 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 964032609 0 0) 0x7f9b04003520 con 0x7f9b1c108be0 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b1c1a6100 con 0x7f9b1c108be0 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9b10001a10 con 0x7f9b1c108be0 2024-09-06T15:08:58.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242981256 0 0) 0x7f9b1c1a72e0 con 0x7f9b1c10c870 2024-09-06T15:08:58.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b04003520 con 0x7f9b1c10c870 2024-09-06T15:08:58.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128350248 0 0) 0x7f9b1c1a4f20 con 0x7f9b1c104760 2024-09-06T15:08:58.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b1c1a72e0 con 0x7f9b1c104760 2024-09-06T15:08:58.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2522897051 0 0) 0x7f9b1c1a6100 con 0x7f9b1c108be0 2024-09-06T15:08:58.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 >> v1:172.21.15.189:6790/0 conn(0x7f9b1c10c870 legacy=0x7f9b1c1a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 >> v1:172.21.15.189:6789/0 conn(0x7f9b1c104760 legacy=0x7f9b1c199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c1a84c0 con 0x7f9b1c108be0 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c1a7510 con 0x7f9b1c108be0 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b1c1a7b40 con 0x7f9b1c108be0 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f9b10001cf0 con 0x7f9b1c108be0 2024-09-06T15:08:58.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9b10005c90 con 0x7f9b1c108be0 2024-09-06T15:08:58.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b080050b0 con 0x7f9b1c108be0 2024-09-06T15:08:58.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.293+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f9b100038c0 con 0x7f9b1c108be0 2024-09-06T15:08:58.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.297+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(27..27 src has 1..27) ==== 2717+0+0 (unknown 3231526633 0 0) 0x7f9b100940b0 con 0x7f9b1c108be0 2024-09-06T15:08:58.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.301+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f9b1005dd50 con 0x7f9b1c108be0 2024-09-06T15:08:58.462 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:08:58.465+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9b08000bc0 con 0x7f9b04078460 2024-09-06T15:08:58.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:58 smithi189 bash[22757]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:58.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:58 smithi189 bash[22757]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:58 smithi189 bash[29727]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:58 smithi189 bash[29727]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:58 smithi190 bash[24979]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:58 smithi190 bash[24979]: cluster 2024-09-06T15:08:58.181302+0000 mgr.y (mgr.14146) 211 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:59.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[22757]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:59.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:08:59 smithi189 bash[29727]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.467743+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24241 v1:172.21.15.190:0/2941194952' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.474572+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.480612+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:59.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:08:59 smithi190 bash[24979]: audit 2024-09-06T15:08:58.482327+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:00.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:00 smithi189 bash[22757]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:00.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:00 smithi189 bash[22757]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:00.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:00 smithi189 bash[29727]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:00.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:00 smithi189 bash[29727]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:00.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:00 smithi190 bash[24979]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:00.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:00 smithi190 bash[24979]: cluster 2024-09-06T15:09:00.181886+0000 mgr.y (mgr.14146) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:02 smithi189 bash[22757]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:02 smithi189 bash[22757]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:02 smithi189 bash[29727]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:02 smithi189 bash[29727]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:02 smithi190 bash[24979]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:02.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:02 smithi190 bash[24979]: cluster 2024-09-06T15:09:02.182489+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.530 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:04 smithi190 bash[24979]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.531 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:04 smithi190 bash[24979]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:04 smithi189 bash[22757]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:04 smithi189 bash[22757]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:04 smithi189 bash[29727]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:04.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:04 smithi189 bash[29727]: cluster 2024-09-06T15:09:04.183036+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:06 smithi190 bash[24979]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:06 smithi190 bash[24979]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:06 smithi189 bash[22757]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:06 smithi189 bash[22757]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:06 smithi189 bash[29727]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:06.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:06 smithi189 bash[29727]: cluster 2024-09-06T15:09:06.183618+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:07.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[22757]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:07.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:07 smithi189 bash[29727]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:07.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.848974+0000 mon.b (mon.1) 11 : audit [INF] from='client.? v1:172.21.15.190:0/2465752834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.849707+0000 mon.a (mon.0) 497 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"} : dispatch 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.852970+0000 mon.a (mon.0) 498 : audit [INF] from='client.24247 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f5ba07bb-3fc6-4137-8006-cee2d487a9e7"}]': finished 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: cluster 2024-09-06T15:09:06.860211+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:07.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:07 smithi190 bash[24979]: audit 2024-09-06T15:09:06.860809+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:08.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[29727]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[29727]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[29727]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[29727]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[22757]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[22757]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[22757]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:08 smithi189 bash[22757]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:08.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:08 smithi190 bash[24979]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:08 smithi190 bash[24979]: audit 2024-09-06T15:09:07.436901+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? v1:172.21.15.190:0/782206732' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:09:08.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:08 smithi190 bash[24979]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:08.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:08 smithi190 bash[24979]: cluster 2024-09-06T15:09:08.184175+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:10 smithi189 bash[22757]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:10 smithi189 bash[22757]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:10 smithi189 bash[29727]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:10 smithi189 bash[29727]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:10 smithi190 bash[24979]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:10.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:10 smithi190 bash[24979]: cluster 2024-09-06T15:09:10.184725+0000 mgr.y (mgr.14146) 218 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:12 smithi189 bash[29727]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:12 smithi189 bash[29727]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:12 smithi189 bash[22757]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:12 smithi189 bash[22757]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:12 smithi190 bash[24979]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:12.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:12 smithi190 bash[24979]: cluster 2024-09-06T15:09:12.185337+0000 mgr.y (mgr.14146) 219 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:14 smithi189 bash[29727]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:14 smithi189 bash[29727]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:14 smithi189 bash[22757]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:14 smithi189 bash[22757]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:14 smithi190 bash[24979]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:14.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:14 smithi190 bash[24979]: cluster 2024-09-06T15:09:14.185890+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:16 smithi189 bash[29727]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:16 smithi189 bash[29727]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:16 smithi189 bash[22757]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:16 smithi189 bash[22757]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:16 smithi190 bash[24979]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:16.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:16 smithi190 bash[24979]: cluster 2024-09-06T15:09:16.186471+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:18 smithi189 bash[29727]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:18 smithi189 bash[29727]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:18 smithi189 bash[22757]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:18 smithi189 bash[22757]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:18 smithi190 bash[24979]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:18.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:18 smithi190 bash[24979]: cluster 2024-09-06T15:09:18.187048+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:20.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[22757]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[22757]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[22757]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[22757]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[29727]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[29727]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[29727]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:20.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:20 smithi189 bash[29727]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:20.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:20 smithi190 bash[24979]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:20 smithi190 bash[24979]: audit 2024-09-06T15:09:20.035119+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T15:09:20.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:20 smithi190 bash[24979]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:20.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:20 smithi190 bash[24979]: audit 2024-09-06T15:09:20.036688+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[22757]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[22757]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[22757]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[22757]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[29727]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[29727]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[29727]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:21 smithi189 bash[29727]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:21.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:21 smithi190 bash[24979]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:21 smithi190 bash[24979]: cephadm 2024-09-06T15:09:20.038097+0000 mgr.y (mgr.14146) 223 : cephadm [INF] Deploying daemon osd.4 on smithi190 2024-09-06T15:09:21.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:21 smithi190 bash[24979]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:21.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:21 smithi190 bash[24979]: cluster 2024-09-06T15:09:20.187669+0000 mgr.y (mgr.14146) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:22 smithi189 bash[22757]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:22 smithi189 bash[22757]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:22 smithi189 bash[29727]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:22 smithi189 bash[29727]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:22 smithi190 bash[24979]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:22.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:22 smithi190 bash[24979]: cluster 2024-09-06T15:09:22.188285+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.408 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:09:24 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:09:24.408 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:24 smithi190 bash[24979]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.408 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:24 smithi190 bash[24979]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.408 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:24 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:09:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:24 smithi189 bash[22757]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:24 smithi189 bash[22757]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:24 smithi189 bash[29727]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:24 smithi189 bash[29727]: cluster 2024-09-06T15:09:24.188873+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:24.665 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:24 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:09:24.665 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:09:24 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:09:25.554 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:25 smithi190 bash[24979]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[22757]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.713089+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.720561+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:25 smithi189 bash[29727]: audit 2024-09-06T15:09:24.728733+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:26 smithi189 bash[29727]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:26 smithi189 bash[29727]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:26.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:26 smithi189 bash[22757]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:26 smithi189 bash[22757]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:26.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:26 smithi190 bash[24979]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:26.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:26 smithi190 bash[24979]: cluster 2024-09-06T15:09:26.189479+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:28 smithi189 bash[22757]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:28 smithi189 bash[22757]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:28 smithi189 bash[29727]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:28 smithi189 bash[29727]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:28 smithi190 bash[24979]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:28.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:28 smithi190 bash[24979]: cluster 2024-09-06T15:09:28.190080+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:30 smithi189 bash[22757]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:30 smithi189 bash[22757]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:30 smithi189 bash[29727]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:30 smithi189 bash[29727]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:30 smithi190 bash[24979]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:30.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:30 smithi190 bash[24979]: cluster 2024-09-06T15:09:30.190654+0000 mgr.y (mgr.14146) 229 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:32.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[22757]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:32 smithi189 bash[29727]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.065842+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.076516+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.078482+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.080138+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:32.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:32 smithi190 bash[24979]: audit 2024-09-06T15:09:31.092258+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:33.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:33 smithi189 bash[22757]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:33.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:33 smithi189 bash[22757]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:33.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:33 smithi189 bash[29727]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:33.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:33 smithi189 bash[29727]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:33 smithi190 bash[24979]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:33 smithi190 bash[24979]: cluster 2024-09-06T15:09:32.191228+0000 mgr.y (mgr.14146) 230 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.561 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:34 smithi190 bash[24979]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.561 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:34 smithi190 bash[24979]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:34 smithi189 bash[22757]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:34 smithi189 bash[22757]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:34 smithi189 bash[29727]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:34.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:34 smithi189 bash[29727]: cluster 2024-09-06T15:09:34.191831+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:35.543 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.544+0000 7f9b18ff9640 1 -- 172.21.15.190:0/2941194952 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 2050657698) 0x7f9b08000bc0 con 0x7f9b04078460 2024-09-06T15:09:35.543 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 4 on host 'smithi190' 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 >> v1:172.21.15.189:6800/4002094494 conn(0x7f9b04078460 legacy=0x7f9b0407a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 >> v1:172.21.15.190:6789/0 conn(0x7f9b1c108be0 legacy=0x7f9b1c1a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 shutdown_connections 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 >> 172.21.15.190:0/2941194952 conn(0x7f9b1c100030 msgr2=0x7f9b1c100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 shutdown_connections 2024-09-06T15:09:35.546 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:35.548+0000 7f9b21f67640 1 -- 172.21.15.190:0/2941194952 wait complete. 2024-09-06T15:09:35.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:35 smithi190 bash[24979]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:35 smithi190 bash[24979]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:35 smithi190 bash[24979]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:35 smithi190 bash[24979]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[22757]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[22757]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[22757]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[22757]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[29727]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[29727]: audit 2024-09-06T15:09:34.569946+0000 mon.b (mon.1) 13 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[29727]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:35.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:35 smithi189 bash[29727]: audit 2024-09-06T15:09:34.570188+0000 mon.a (mon.0) 511 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T15:09:36.144 DEBUG:teuthology.orchestra.run.smithi190:osd.4> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.4.service 2024-09-06T15:09:36.146 INFO:tasks.cephadm:Deploying osd.5 on smithi190 with /dev/vg_nvme/lv_3... 2024-09-06T15:09:36.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[22757]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:36.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:36 smithi189 bash[29727]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:36.626 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[28364]: debug 2024-09-06T15:09:36.312+0000 7f9150b2d640 -1 osd.4 0 waiting for initial osdmap 2024-09-06T15:09:36.627 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[28364]: debug 2024-09-06T15:09:36.316+0000 7f914c954640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.300635+0000 mon.a (mon.0) 512 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.308478+0000 mon.b (mon.1) 14 : audit [INF] from='osd.4 v1:172.21.15.190:6800/2144496764' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.309864+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.310873+0000 mon.a (mon.0) 514 : audit [INF] from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.316784+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:36.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.527424+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.534486+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: audit 2024-09-06T15:09:35.542701+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:36.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:36 smithi190 bash[24979]: cluster 2024-09-06T15:09:36.192410+0000 mgr.y (mgr.14146) 232 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:37.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[22757]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:37 smithi189 bash[29727]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.302880+0000 mon.a (mon.0) 519 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:09:37.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: cluster 2024-09-06T15:09:36.308104+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-09-06T15:09:37.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.309057+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:37.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:37 smithi190 bash[24979]: audit 2024-09-06T15:09:36.318321+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[22757]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:38.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:38 smithi189 bash[29727]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:38.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.611073+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:35.611158+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:37.318680+0000 mon.a (mon.0) 523 : cluster [INF] osd.4 v1:172.21.15.190:6800/2144496764 boot 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:37.318885+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: audit 2024-09-06T15:09:37.320038+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:38.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:38 smithi190 bash[24979]: cluster 2024-09-06T15:09:38.192948+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-06T15:09:39.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:39 smithi189 bash[22757]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:39.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:39 smithi189 bash[22757]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:39.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:39 smithi189 bash[29727]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:39.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:39 smithi189 bash[29727]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:39.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:39 smithi190 bash[24979]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:39.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:39 smithi190 bash[24979]: cluster 2024-09-06T15:09:38.321379+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-06T15:09:40.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[22757]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[22757]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[22757]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[22757]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[29727]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[29727]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[29727]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:40 smithi189 bash[29727]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:40 smithi190 bash[24979]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:40 smithi190 bash[24979]: cluster 2024-09-06T15:09:39.331787+0000 mon.a (mon.0) 527 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-06T15:09:40.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:40 smithi190 bash[24979]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:40 smithi190 bash[24979]: cluster 2024-09-06T15:09:40.193607+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:40.905 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:09:42.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:42 smithi189 bash[22757]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:42.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:42 smithi189 bash[22757]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:42.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:42 smithi189 bash[29727]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:42.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:42 smithi189 bash[29727]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:42.609 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:42 smithi190 bash[24979]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:42.609 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:42 smithi190 bash[24979]: cluster 2024-09-06T15:09:42.194239+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.538 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:44 smithi190 bash[24979]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.538 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:44 smithi190 bash[24979]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:44 smithi189 bash[22757]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:44 smithi189 bash[22757]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:44 smithi189 bash[29727]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:44.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:44 smithi189 bash[29727]: cluster 2024-09-06T15:09:44.194854+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-06T15:09:45.704 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:09:45.744 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_3 2024-09-06T15:09:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:46 smithi189 bash[22757]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:46 smithi189 bash[22757]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:46.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:46 smithi189 bash[29727]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:46.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:46 smithi189 bash[29727]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:46 smithi190 bash[24979]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:46 smithi190 bash[24979]: cluster 2024-09-06T15:09:46.195417+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:48 smithi189 bash[22757]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:48 smithi189 bash[22757]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:48 smithi189 bash[29727]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:48 smithi189 bash[29727]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:48 smithi190 bash[24979]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:48.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:48 smithi190 bash[24979]: cluster 2024-09-06T15:09:48.196016+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.851 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[22757]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.853 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:49 smithi189 bash[29727]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.876 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: cephadm 2024-09-06T15:09:48.562801+0000 mgr.y (mgr.14146) 239 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.571152+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.581455+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.584123+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: cephadm 2024-09-06T15:09:48.585455+0000 mgr.y (mgr.14146) 240 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 17265M 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.593762+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.877 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.599032+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:49.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.600659+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:49.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:49.878 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:49 smithi190 bash[24979]: audit 2024-09-06T15:09:48.612627+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:09:50.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:50 smithi189 bash[22757]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:50.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:50 smithi189 bash[22757]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:50.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:50 smithi189 bash[29727]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:50.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:50 smithi189 bash[29727]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:50.876 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:50 smithi190 bash[24979]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:50.876 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:50 smithi190 bash[24979]: cluster 2024-09-06T15:09:50.196617+0000 mgr.y (mgr.14146) 241 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-06T15:09:51.020 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:09:52.198 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3980894806 >> v1:172.21.15.190:6789/0 conn(0x7fa48810a6b0 legacy=0x7fa48810cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:52.198 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3980894806 shutdown_connections 2024-09-06T15:09:52.198 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3980894806 >> 172.21.15.190:0/3980894806 conn(0x7fa4880fcd50 msgr2=0x7fa4880ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:52.198 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3980894806 shutdown_connections 2024-09-06T15:09:52.198 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3980894806 wait complete. 2024-09-06T15:09:52.199 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 Processor -- start 2024-09-06T15:09:52.199 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- start start 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4881a2ec0 con 0x7fa488106900 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4881a40a0 con 0x7fa48810a6b0 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa4881a5280 con 0x7fa48806bbb0 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48d489640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa48810a6b0 0x7fa4881a17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:42320/0 (socket says 172.21.15.190:42320) 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48d489640 1 -- 172.21.15.190:0/3151049400 learned_addr learned my addr 172.21.15.190:0/3151049400 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515447814 0 0) 0x7fa4881a40a0 con 0x7fa48810a6b0 2024-09-06T15:09:52.200 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470003520 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2819833829 0 0) 0x7fa470003520 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4881a40a0 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fa480001830 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289483890 0 0) 0x7fa4881a5280 con 0x7fa48806bbb0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470003520 con 0x7fa48806bbb0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727105646 0 0) 0x7fa4881a2ec0 con 0x7fa488106900 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4881a5280 con 0x7fa488106900 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1664960100 0 0) 0x7fa4881a40a0 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 >> v1:172.21.15.189:6790/0 conn(0x7fa48806bbb0 legacy=0x7fa488197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 >> v1:172.21.15.189:6789/0 conn(0x7fa488106900 legacy=0x7fa48819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881a6460 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4881a54b0 con 0x7fa48810a6b0 2024-09-06T15:09:52.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4881a5ae0 con 0x7fa48810a6b0 2024-09-06T15:09:52.202 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fa480003b80 con 0x7fa48810a6b0 2024-09-06T15:09:52.202 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.200+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fa480005140 con 0x7fa48810a6b0 2024-09-06T15:09:52.202 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.204+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4740050b0 con 0x7fa48810a6b0 2024-09-06T15:09:52.202 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.204+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7fa480001d00 con 0x7fa48810a6b0 2024-09-06T15:09:52.202 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.204+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 3119+0+0 (unknown 2441287529 0 0) 0x7fa480094800 con 0x7fa48810a6b0 2024-09-06T15:09:52.206 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.208+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fa48005e310 con 0x7fa48810a6b0 2024-09-06T15:09:52.379 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:09:52.380+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa474000bc0 con 0x7fa4700782d0 2024-09-06T15:09:52.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:52 smithi189 bash[22757]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:52.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:52 smithi189 bash[22757]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:52.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:52 smithi189 bash[29727]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:52.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:52 smithi189 bash[29727]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:52.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:52 smithi190 bash[24979]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:52.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:52 smithi190 bash[24979]: cluster 2024-09-06T15:09:52.197236+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:09:53.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[22757]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:53.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:53 smithi189 bash[29727]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:53.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.385330+0000 mgr.y (mgr.14146) 243 : audit [DBG] from='client.24268 v1:172.21.15.190:0/3151049400' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:53.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.391727+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:09:53.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.397719+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:09:53.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:53.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:53 smithi190 bash[24979]: audit 2024-09-06T15:09:52.399509+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:54.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:54 smithi189 bash[22757]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:54.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:54 smithi189 bash[22757]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:54.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:54 smithi189 bash[29727]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:54.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:54 smithi189 bash[29727]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:54.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:54 smithi190 bash[24979]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:54.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:54 smithi190 bash[24979]: cluster 2024-09-06T15:09:54.197796+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:56 smithi189 bash[29727]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:56 smithi189 bash[29727]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:56 smithi189 bash[22757]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:56 smithi189 bash[22757]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:56 smithi190 bash[24979]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:56.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:56 smithi190 bash[24979]: cluster 2024-09-06T15:09:56.198352+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:58 smithi190 bash[24979]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:09:58 smithi190 bash[24979]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:58 smithi189 bash[22757]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:09:58 smithi189 bash[22757]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:58 smithi189 bash[29727]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:09:58.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:09:58 smithi189 bash[29727]: cluster 2024-09-06T15:09:58.198968+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:00.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:00 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:00.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:00 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:00.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:00 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:00.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:00 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:00.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:00 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:00.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:00 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.000165+0000 mon.a (mon.0) 538 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[29727]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:01.352 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:01 smithi189 bash[22757]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.199537+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.864433+0000 mon.b (mon.1) 15 : audit [INF] from='client.? v1:172.21.15.190:0/129169263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.864584+0000 mon.a (mon.0) 539 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"} : dispatch 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.867789+0000 mon.a (mon.0) 540 : audit [INF] from='client.24274 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30ac143b-0f07-4633-8b54-941c8129c409"}]': finished 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: cluster 2024-09-06T15:10:00.873213+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:01.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:01 smithi190 bash[24979]: audit 2024-09-06T15:10:00.873657+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:02.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:02 smithi189 bash[29727]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:02.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:02 smithi189 bash[29727]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:02.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:02 smithi189 bash[22757]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:02.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:02 smithi189 bash[22757]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:02 smithi190 bash[24979]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:02.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:02 smithi190 bash[24979]: audit 2024-09-06T15:10:01.459316+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? v1:172.21.15.190:0/1468193509' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:03.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:03 smithi189 bash[29727]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:03.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:03 smithi189 bash[29727]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:03.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:03 smithi189 bash[22757]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:03.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:03 smithi189 bash[22757]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:03.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:03 smithi190 bash[24979]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:03.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:03 smithi190 bash[24979]: cluster 2024-09-06T15:10:02.200179+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:04 smithi189 bash[29727]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:04 smithi189 bash[29727]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:04 smithi189 bash[22757]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:04 smithi189 bash[22757]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:04 smithi190 bash[24979]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:04.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:04 smithi190 bash[24979]: cluster 2024-09-06T15:10:04.200775+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:06 smithi189 bash[29727]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:06 smithi189 bash[29727]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:06 smithi189 bash[22757]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:06 smithi189 bash[22757]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:06 smithi190 bash[24979]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:06.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:06 smithi190 bash[24979]: cluster 2024-09-06T15:10:06.201331+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:08 smithi189 bash[29727]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:08 smithi189 bash[29727]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:08 smithi189 bash[22757]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:08 smithi189 bash[22757]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:08 smithi190 bash[24979]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:08.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:08 smithi190 bash[24979]: cluster 2024-09-06T15:10:08.201911+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:10 smithi189 bash[22757]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:10 smithi189 bash[22757]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:10 smithi189 bash[29727]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:10 smithi189 bash[29727]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:10 smithi190 bash[24979]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:10.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:10 smithi190 bash[24979]: cluster 2024-09-06T15:10:10.202484+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:12 smithi189 bash[29727]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:12 smithi189 bash[29727]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:12 smithi189 bash[22757]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:12 smithi189 bash[22757]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:12 smithi190 bash[24979]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:12.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:12 smithi190 bash[24979]: cluster 2024-09-06T15:10:12.203085+0000 mgr.y (mgr.14146) 253 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[22757]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[22757]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[22757]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[22757]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[29727]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[29727]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[29727]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:14.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:14 smithi189 bash[29727]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:14.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:14 smithi190 bash[24979]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:14 smithi190 bash[24979]: audit 2024-09-06T15:10:14.176599+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T15:10:14.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:14 smithi190 bash[24979]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:14.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:14 smithi190 bash[24979]: audit 2024-09-06T15:10:14.178258+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[22757]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[22757]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[22757]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[22757]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[29727]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[29727]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[29727]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:15 smithi189 bash[29727]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:15.604 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:15 smithi190 bash[24979]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.604 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:15 smithi190 bash[24979]: cephadm 2024-09-06T15:10:14.179612+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Deploying daemon osd.5 on smithi190 2024-09-06T15:10:15.604 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:15 smithi190 bash[24979]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:15.604 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:15 smithi190 bash[24979]: cluster 2024-09-06T15:10:14.203637+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.483 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:17 smithi190 bash[24979]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.483 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:17 smithi190 bash[24979]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:17 smithi189 bash[22757]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:17 smithi189 bash[22757]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:17 smithi189 bash[29727]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:17 smithi189 bash[29727]: cluster 2024-09-06T15:10:16.204224+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:18.529 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:18.530 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:18.530 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:18.802 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:18.803 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:18.803 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:10:18 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[22757]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:19 smithi189 bash[29727]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: cluster 2024-09-06T15:10:18.204815+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.850804+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.857888+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:19.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:19 smithi190 bash[24979]: audit 2024-09-06T15:10:18.866277+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:21.476 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:21 smithi190 bash[24979]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:21.476 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:21 smithi190 bash[24979]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:21 smithi189 bash[22757]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:21.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:21 smithi189 bash[22757]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:21 smithi189 bash[29727]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:21 smithi189 bash[29727]: cluster 2024-09-06T15:10:20.205372+0000 mgr.y (mgr.14146) 258 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:22 smithi189 bash[29727]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:22 smithi189 bash[29727]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:22 smithi189 bash[22757]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:22 smithi189 bash[22757]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:22 smithi190 bash[24979]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:22 smithi190 bash[24979]: cluster 2024-09-06T15:10:22.205990+0000 mgr.y (mgr.14146) 259 : cluster [DBG] pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:24 smithi189 bash[22757]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:24 smithi189 bash[22757]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:24 smithi189 bash[29727]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:24 smithi189 bash[29727]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:24 smithi190 bash[24979]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:24.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:24 smithi190 bash[24979]: cluster 2024-09-06T15:10:24.206546+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:26.240 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.240 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.240 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.240 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.240 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.241 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.241 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.241 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.241 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.241 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:26 smithi190 bash[24979]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[29727]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.220296+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.228689+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.230884+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.232704+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:26.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:26.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:26 smithi189 bash[22757]: audit 2024-09-06T15:10:25.242749+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:27.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:27 smithi189 bash[29727]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:27.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:27 smithi189 bash[29727]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:27.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:27 smithi189 bash[22757]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:27.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:27 smithi189 bash[22757]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:27.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:27 smithi190 bash[24979]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:27.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:27 smithi190 bash[24979]: cluster 2024-09-06T15:10:26.207126+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:28 smithi190 bash[24979]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.558 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:28 smithi190 bash[24979]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:28 smithi189 bash[29727]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:28 smithi189 bash[29727]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:28 smithi189 bash[22757]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:28.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:28 smithi189 bash[22757]: cluster 2024-09-06T15:10:28.207698+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:29.464 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.464+0000 7fa485ffb640 1 -- 172.21.15.190:0/3151049400 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 640639766) 0x7fa474000bc0 con 0x7fa4700782d0 2024-09-06T15:10:29.464 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 5 on host 'smithi190' 2024-09-06T15:10:29.466 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 >> v1:172.21.15.189:6800/4002094494 conn(0x7fa4700782d0 legacy=0x7fa47007a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:29.467 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 >> v1:172.21.15.190:6789/0 conn(0x7fa48810a6b0 legacy=0x7fa4881a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:29.467 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 shutdown_connections 2024-09-06T15:10:29.467 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 >> 172.21.15.190:0/3151049400 conn(0x7fa4880fcd50 msgr2=0x7fa4880ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:29.467 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 shutdown_connections 2024-09-06T15:10:29.467 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:29.468+0000 7fa48eeec640 1 -- 172.21.15.190:0/3151049400 wait complete. 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[29727]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[29727]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[29727]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[29727]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[22757]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[22757]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[22757]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:29 smithi189 bash[22757]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:29 smithi190 bash[24979]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:29 smithi190 bash[24979]: audit 2024-09-06T15:10:28.567634+0000 mon.a (mon.0) 553 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:29 smithi190 bash[24979]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:29.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:29 smithi190 bash[24979]: audit 2024-09-06T15:10:28.567738+0000 mon.b (mon.1) 17 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T15:10:30.121 DEBUG:teuthology.orchestra.run.smithi190:osd.5> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.5.service 2024-09-06T15:10:30.123 INFO:tasks.cephadm:Deploying osd.6 on smithi190 with /dev/vg_nvme/lv_2... 2024-09-06T15:10:30.124 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-06T15:10:30.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:30.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[24979]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:30.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[22757]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.306538+0000 mon.a (mon.0) 554 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.311964+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.312557+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:30.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.313067+0000 mon.b (mon.1) 18 : audit [INF] from='osd.5 v1:172.21.15.190:6804/1567707916' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.313277+0000 mon.a (mon.0) 557 : audit [INF] from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.443780+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.451520+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: audit 2024-09-06T15:10:29.460311+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:30.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:30 smithi189 bash[29727]: cluster 2024-09-06T15:10:30.208257+0000 mgr.y (mgr.14146) 263 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-09-06T15:10:31.126 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[33981]: debug 2024-09-06T15:10:30.844+0000 7f0883590640 -1 osd.5 0 waiting for initial osdmap 2024-09-06T15:10:31.126 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:10:30 smithi190 bash[33981]: debug 2024-09-06T15:10:30.852+0000 7f087b3af640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T15:10:31.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[22757]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:31 smithi189 bash[29727]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.308890+0000 mon.a (mon.0) 561 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:30.314823+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.315712+0000 mon.a (mon.0) 563 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.327457+0000 mon.a (mon.0) 564 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:30.855877+0000 mon.a (mon.0) 565 : audit [INF] from='osd.5 ' entity='osd.5' 2024-09-06T15:10:31.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:31.317000+0000 mon.a (mon.0) 566 : cluster [INF] osd.5 v1:172.21.15.190:6804/1567707916 boot 2024-09-06T15:10:31.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: cluster 2024-09-06T15:10:31.317107+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-09-06T15:10:31.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:31.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:31 smithi190 bash[24979]: audit 2024-09-06T15:10:31.317341+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:32.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[22757]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:32.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:32 smithi189 bash[29727]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.520727+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:29.520800+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:32.208847+0000 mgr.y (mgr.14146) 264 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:32.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:32 smithi190 bash[24979]: cluster 2024-09-06T15:10:32.319801+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-06T15:10:34.514 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:10:34.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[29727]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[29727]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[29727]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[29727]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[22757]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[22757]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[22757]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:34.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:34 smithi189 bash[22757]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:34.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:34 smithi190 bash[24979]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:34 smithi190 bash[24979]: cluster 2024-09-06T15:10:33.333667+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-06T15:10:34.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:34 smithi190 bash[24979]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:34.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:34 smithi190 bash[24979]: cluster 2024-09-06T15:10:34.209427+0000 mgr.y (mgr.14146) 265 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:36 smithi189 bash[29727]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:36 smithi189 bash[29727]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:36 smithi189 bash[22757]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:36 smithi189 bash[22757]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:36 smithi190 bash[24979]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:36.681 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:36 smithi190 bash[24979]: cluster 2024-09-06T15:10:36.210038+0000 mgr.y (mgr.14146) 266 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 530 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:38 smithi189 bash[22757]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:38 smithi189 bash[22757]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:38 smithi189 bash[29727]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:38 smithi189 bash[29727]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:38 smithi190 bash[24979]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:38.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:38 smithi190 bash[24979]: cluster 2024-09-06T15:10:38.210668+0000 mgr.y (mgr.14146) 267 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:39.364 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:10:39.414 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_2 2024-09-06T15:10:40.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:40 smithi189 bash[22757]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:40.850 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:40 smithi189 bash[22757]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:40.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:40 smithi189 bash[29727]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:40.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:40 smithi189 bash[29727]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:40.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:40 smithi190 bash[24979]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:40.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:40 smithi190 bash[24979]: cluster 2024-09-06T15:10:40.211353+0000 mgr.y (mgr.14146) 268 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[22757]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:43 smithi189 bash[29727]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: cluster 2024-09-06T15:10:42.211985+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:43.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: cephadm 2024-09-06T15:10:42.230191+0000 mgr.y (mgr.14146) 270 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.238691+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.249755+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.252402+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.254047+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.264654+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.270780+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:43.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.277029+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:43.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:43 smithi190 bash[24979]: audit 2024-09-06T15:10:42.289235+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:10:44.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:44 smithi189 bash[22757]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:44 smithi189 bash[22757]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:44 smithi189 bash[29727]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:44 smithi189 bash[29727]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:44 smithi190 bash[24979]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:44 smithi190 bash[24979]: cephadm 2024-09-06T15:10:42.255229+0000 mgr.y (mgr.14146) 271 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 8632M 2024-09-06T15:10:44.690 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:10:45.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:45 smithi189 bash[22757]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:45 smithi189 bash[22757]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:45 smithi189 bash[29727]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:45 smithi189 bash[29727]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:45 smithi190 bash[24979]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:45 smithi190 bash[24979]: cluster 2024-09-06T15:10:44.212653+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:45.990 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- 172.21.15.190:0/864066024 >> v1:172.21.15.190:6789/0 conn(0x7f2ca406bc50 legacy=0x7f2ca4105140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.990 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- 172.21.15.190:0/864066024 shutdown_connections 2024-09-06T15:10:45.990 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- 172.21.15.190:0/864066024 >> 172.21.15.190:0/864066024 conn(0x7f2ca40fcd50 msgr2=0x7f2ca40ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:45.990 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- 172.21.15.190:0/864066024 shutdown_connections 2024-09-06T15:10:45.990 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- 172.21.15.190:0/864066024 wait complete. 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 Processor -- start 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- start start 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ca41a2ce0 con 0x7f2ca41068f0 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ca41a3ec0 con 0x7f2ca410a670 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2caaf32640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ca41a50a0 con 0x7f2ca406bc50 2024-09-06T15:10:45.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2ca94cf640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2ca410a670 0x7f2ca41a15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:45978/0 (socket says 172.21.15.190:45978) 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2ca94cf640 1 -- 172.21.15.190:0/3568803035 learned_addr learned my addr 172.21.15.190:0/3568803035 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261664780 0 0) 0x7f2ca41a3ec0 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.991+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c8c003520 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3342161956 0 0) 0x7f2c8c003520 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ca41a3ec0 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2c9c001950 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692864754 0 0) 0x7f2ca41a2ce0 con 0x7f2ca41068f0 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c8c003520 con 0x7f2ca41068f0 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276589818 0 0) 0x7f2ca41a50a0 con 0x7f2ca406bc50 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca41a2ce0 con 0x7f2ca406bc50 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 255578921 0 0) 0x7f2ca41a3ec0 con 0x7f2ca410a670 2024-09-06T15:10:45.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 >> v1:172.21.15.189:6790/0 conn(0x7f2ca406bc50 legacy=0x7f2ca4197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 >> v1:172.21.15.189:6789/0 conn(0x7f2ca41068f0 legacy=0x7f2ca419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca41a6280 con 0x7f2ca410a670 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca41a2f10 con 0x7f2ca410a670 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ca41a3540 con 0x7f2ca410a670 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f2c9c003a60 con 0x7f2ca410a670 2024-09-06T15:10:45.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2c9c005b40 con 0x7f2ca410a670 2024-09-06T15:10:45.995 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c900050b0 con 0x7f2ca410a670 2024-09-06T15:10:45.995 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f2c9c0035f0 con 0x7f2ca410a670 2024-09-06T15:10:45.995 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.995+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(39..39 src has 1..39) ==== 3411+0+0 (unknown 3697315343 0 0) 0x7f2c9c094210 con 0x7f2ca410a670 2024-09-06T15:10:45.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:45.999+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f2c9c05dbf0 con 0x7f2ca410a670 2024-09-06T15:10:46.169 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:10:46.171+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2c90000bc0 con 0x7f2c8c078390 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[22757]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:46.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:46 smithi189 bash[29727]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:46.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.175680+0000 mgr.y (mgr.14146) 273 : audit [DBG] from='client.24295 v1:172.21.15.190:0/3568803035' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.182240+0000 mon.a (mon.0) 579 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.188561+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: audit 2024-09-06T15:10:46.190352+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:46.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:46 smithi190 bash[24979]: cluster 2024-09-06T15:10:46.213247+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:48 smithi189 bash[22757]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:48 smithi189 bash[22757]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:48 smithi189 bash[29727]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:48 smithi189 bash[29727]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:48 smithi190 bash[24979]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:48.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:48 smithi190 bash[24979]: cluster 2024-09-06T15:10:48.213845+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:50 smithi189 bash[22757]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:50 smithi189 bash[22757]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:50 smithi189 bash[29727]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:50 smithi189 bash[29727]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:50 smithi190 bash[24979]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:50.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:50 smithi190 bash[24979]: cluster 2024-09-06T15:10:50.214439+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.552 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:52 smithi190 bash[24979]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.552 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:52 smithi190 bash[24979]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:52 smithi189 bash[22757]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:52 smithi189 bash[22757]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:52 smithi189 bash[29727]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:52.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:52 smithi189 bash[29727]: cluster 2024-09-06T15:10:52.215019+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:54 smithi189 bash[22757]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:54 smithi189 bash[22757]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:54 smithi189 bash[29727]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:54 smithi189 bash[29727]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:54 smithi190 bash[24979]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:54.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:54 smithi190 bash[24979]: cluster 2024-09-06T15:10:54.215613+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[22757]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:55.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:55 smithi189 bash[29727]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:55.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.824214+0000 mon.b (mon.1) 19 : audit [INF] from='client.? v1:172.21.15.190:0/3377816650' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.824305+0000 mon.a (mon.0) 582 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"} : dispatch 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.827662+0000 mon.a (mon.0) 583 : audit [INF] from='client.24301 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ace6a61d-47ae-4d92-83c4-7f49e30714bb"}]': finished 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: cluster 2024-09-06T15:10:54.832958+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:55.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:55 smithi190 bash[24979]: audit 2024-09-06T15:10:54.833540+0000 mon.a (mon.0) 585 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:10:56.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[22757]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[22757]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[22757]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[22757]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[29727]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[29727]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[29727]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:56.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:56 smithi189 bash[29727]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:56.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:56 smithi190 bash[24979]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:56 smithi190 bash[24979]: audit 2024-09-06T15:10:55.429217+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? v1:172.21.15.190:0/72856879' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:10:56.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:56 smithi190 bash[24979]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:56.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:56 smithi190 bash[24979]: cluster 2024-09-06T15:10:56.216287+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:58 smithi189 bash[29727]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:10:58 smithi189 bash[29727]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:58 smithi189 bash[22757]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:10:58 smithi189 bash[22757]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:58 smithi190 bash[24979]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:10:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:10:58 smithi190 bash[24979]: cluster 2024-09-06T15:10:58.217010+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:00 smithi189 bash[29727]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:00 smithi189 bash[29727]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:00 smithi189 bash[22757]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:00 smithi189 bash[22757]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:00 smithi190 bash[24979]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:00.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:00 smithi190 bash[24979]: cluster 2024-09-06T15:11:00.217632+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:02 smithi189 bash[22757]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:02 smithi189 bash[22757]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:02 smithi189 bash[29727]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:02 smithi189 bash[29727]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:02 smithi190 bash[24979]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:02.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:02 smithi190 bash[24979]: cluster 2024-09-06T15:11:02.218322+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:04 smithi189 bash[22757]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:04 smithi189 bash[22757]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:04 smithi189 bash[29727]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:04 smithi189 bash[29727]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:04 smithi190 bash[24979]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:04.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:04 smithi190 bash[24979]: cluster 2024-09-06T15:11:04.219046+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:06 smithi189 bash[22757]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:06 smithi189 bash[22757]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:06 smithi189 bash[29727]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:06 smithi189 bash[29727]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:06 smithi190 bash[24979]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:06.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:06 smithi190 bash[24979]: cluster 2024-09-06T15:11:06.219678+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[29727]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[29727]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[29727]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:08.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[29727]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:08.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[22757]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[22757]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[22757]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:08.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:08 smithi189 bash[22757]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:08.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:08 smithi190 bash[24979]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:08 smithi190 bash[24979]: audit 2024-09-06T15:11:08.175124+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-06T15:11:08.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:08 smithi190 bash[24979]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:08.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:08 smithi190 bash[24979]: audit 2024-09-06T15:11:08.176852+0000 mon.a (mon.0) 587 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:09.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[22757]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[22757]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[22757]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[22757]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[29727]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[29727]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[29727]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:09.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:09 smithi189 bash[29727]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:09.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:09 smithi190 bash[24979]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:09 smithi190 bash[24979]: cephadm 2024-09-06T15:11:08.178370+0000 mgr.y (mgr.14146) 285 : cephadm [INF] Deploying daemon osd.6 on smithi190 2024-09-06T15:11:09.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:09 smithi190 bash[24979]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:09.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:09 smithi190 bash[24979]: cluster 2024-09-06T15:11:08.220283+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:11 smithi190 bash[24979]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.555 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:11 smithi190 bash[24979]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:11 smithi189 bash[22757]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:11 smithi189 bash[22757]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:11 smithi189 bash[29727]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:11.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:11 smithi189 bash[29727]: cluster 2024-09-06T15:11:10.220886+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:12.840 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:12.841 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:12.841 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:12.841 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:13.094 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:13.095 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:13.095 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:13.096 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:11:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:13 smithi190 bash[24979]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[22757]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: cluster 2024-09-06T15:11:12.221499+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.142588+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:13.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.150018+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:13.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:13 smithi189 bash[29727]: audit 2024-09-06T15:11:13.158494+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:15.567 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:15 smithi190 bash[24979]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:15.567 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:15 smithi190 bash[24979]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:15 smithi189 bash[22757]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:15 smithi189 bash[22757]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:15.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:15 smithi189 bash[29727]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:15.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:15 smithi189 bash[29727]: cluster 2024-09-06T15:11:14.222210+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:17 smithi189 bash[22757]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:17 smithi189 bash[22757]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:17 smithi189 bash[29727]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:17 smithi189 bash[29727]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:17 smithi190 bash[24979]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:17.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:17 smithi190 bash[24979]: cluster 2024-09-06T15:11:16.222954+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:19 smithi189 bash[22757]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:19 smithi189 bash[22757]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:19 smithi189 bash[29727]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:19 smithi189 bash[29727]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:19 smithi190 bash[24979]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:19.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:19 smithi190 bash[24979]: cluster 2024-09-06T15:11:18.223700+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:21 smithi190 bash[24979]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[22757]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.095731+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.105982+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: cluster 2024-09-06T15:11:20.224413+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.813197+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.814701+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:21.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:21 smithi189 bash[29727]: audit 2024-09-06T15:11:20.824115+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:22.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:22 smithi190 bash[24979]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:22 smithi190 bash[24979]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:22 smithi190 bash[24979]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:22 smithi190 bash[24979]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[29727]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[29727]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[29727]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[29727]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[22757]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[22757]: audit 2024-09-06T15:11:22.132169+0000 mon.a (mon.0) 596 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[22757]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:22 smithi189 bash[22757]: audit 2024-09-06T15:11:22.132510+0000 mon.b (mon.1) 21 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-06T15:11:23.556 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.556 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.556 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:23.557 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:23 smithi190 bash[24979]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:23.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[22757]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.193490+0000 mon.a (mon.0) 597 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: cluster 2024-09-06T15:11:22.198565+0000 mon.a (mon.0) 598 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.199033+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.201424+0000 mon.a (mon.0) 600 : audit [INF] from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: audit 2024-09-06T15:11:22.201727+0000 mon.b (mon.1) 22 : audit [INF] from='osd.6 v1:172.21.15.190:6808/507475988' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:11:23.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:23.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:23 smithi189 bash[29727]: cluster 2024-09-06T15:11:22.224996+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:24.094 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.095+0000 7f2ca1ffb640 1 -- 172.21.15.190:0/3568803035 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 3255914698) 0x7f2c90000bc0 con 0x7f2c8c078390 2024-09-06T15:11:24.094 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 6 on host 'smithi190' 2024-09-06T15:11:24.096 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 >> v1:172.21.15.189:6800/4002094494 conn(0x7f2c8c078390 legacy=0x7f2c8c07a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 >> v1:172.21.15.190:6789/0 conn(0x7f2ca410a670 legacy=0x7f2ca41a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 shutdown_connections 2024-09-06T15:11:24.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 >> 172.21.15.190:0/3568803035 conn(0x7f2ca40fcd50 msgr2=0x7f2ca40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:24.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 shutdown_connections 2024-09-06T15:11:24.097 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:24.099+0000 7f2caaf32640 1 -- 172.21.15.190:0/3568803035 wait complete. 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:24 smithi190 bash[24979]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[22757]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.196129+0000 mon.a (mon.0) 601 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.203187+0000 mon.a (mon.0) 602 : cluster [DBG] osdmap e42: 7 total, 6 up, 7 in 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.204586+0000 mon.a (mon.0) 603 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:23.213633+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.075474+0000 mon.a (mon.0) 605 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.083235+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:24 smithi189 bash[29727]: audit 2024-09-06T15:11:24.093806+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:24.751 DEBUG:teuthology.orchestra.run.smithi190:osd.6> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.6.service 2024-09-06T15:11:24.754 INFO:tasks.cephadm:Deploying osd.7 on smithi190 with /dev/vg_nvme/lv_1... 2024-09-06T15:11:24.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[22757]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:25.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:25 smithi189 bash[29727]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.112403+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:23.112509+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.205935+0000 mon.a (mon.0) 608 : cluster [INF] osd.6 v1:172.21.15.190:6808/507475988 boot 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.206028+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2024-09-06T15:11:25.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: audit 2024-09-06T15:11:24.206371+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:11:25.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.225521+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-06T15:11:25.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:25.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:25 smithi190 bash[24979]: cluster 2024-09-06T15:11:24.396951+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2024-09-06T15:11:26.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[22757]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[22757]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[22757]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:26.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[22757]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:26.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[29727]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[29727]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[29727]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:26.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:26 smithi189 bash[29727]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:26.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:26 smithi190 bash[24979]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:26 smithi190 bash[24979]: cluster 2024-09-06T15:11:25.395806+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-09-06T15:11:26.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:26 smithi190 bash[24979]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:26.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:26 smithi190 bash[24979]: cluster 2024-09-06T15:11:26.226138+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:28 smithi189 bash[22757]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:28 smithi189 bash[22757]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:28 smithi189 bash[29727]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:28 smithi189 bash[29727]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:28 smithi190 bash[24979]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:28.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:28 smithi190 bash[24979]: cluster 2024-09-06T15:11:28.226896+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:29.142 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:11:30.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:30 smithi189 bash[22757]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:30.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:30 smithi189 bash[22757]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:30.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:30 smithi189 bash[29727]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:30.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:30 smithi189 bash[29727]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:30.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:30 smithi190 bash[24979]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:30.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:30 smithi190 bash[24979]: cluster 2024-09-06T15:11:30.227653+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:32 smithi190 bash[24979]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:32 smithi190 bash[24979]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:32 smithi189 bash[22757]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:32 smithi189 bash[22757]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:32 smithi189 bash[29727]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:32.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:32 smithi189 bash[29727]: cluster 2024-09-06T15:11:32.228274+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:34 smithi189 bash[22757]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:34 smithi189 bash[22757]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:34 smithi189 bash[29727]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:34 smithi189 bash[29727]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:34 smithi190 bash[24979]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:34.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:34 smithi190 bash[24979]: cluster 2024-09-06T15:11:34.228864+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.351 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.353 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.354 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[22757]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.354 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:35 smithi189 bash[29727]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: cephadm 2024-09-06T15:11:34.936954+0000 mgr.y (mgr.14146) 300 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.945592+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.954393+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.957453+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.959185+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.960752+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: cephadm 2024-09-06T15:11:34.961960+0000 mgr.y (mgr.14146) 301 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 5755M 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.970766+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.975018+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:36.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.976841+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:36.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:36.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:35 smithi190 bash[24979]: audit 2024-09-06T15:11:34.988913+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:11:37.313 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-09-06T15:11:37.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:36 smithi190 bash[24979]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:37.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:36 smithi190 bash[24979]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:37.349 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi190:vg_nvme/lv_1 2024-09-06T15:11:37.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:36 smithi189 bash[29727]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:37.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:36 smithi189 bash[29727]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:37.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:36 smithi189 bash[22757]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:37.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:36 smithi189 bash[22757]: cluster 2024-09-06T15:11:36.229490+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:38 smithi189 bash[22757]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:38 smithi189 bash[22757]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:38 smithi189 bash[29727]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:38 smithi189 bash[29727]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:38 smithi190 bash[24979]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:38.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:38 smithi190 bash[24979]: cluster 2024-09-06T15:11:38.230125+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:40 smithi189 bash[22757]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:40 smithi189 bash[22757]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:40 smithi189 bash[29727]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:40 smithi189 bash[29727]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:40 smithi190 bash[24979]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:40.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:40 smithi190 bash[24979]: cluster 2024-09-06T15:11:40.230762+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.103 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:11:42.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:42 smithi189 bash[22757]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:42 smithi189 bash[22757]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:42 smithi189 bash[29727]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:42 smithi189 bash[29727]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:42 smithi190 bash[24979]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:42.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:42 smithi190 bash[24979]: cluster 2024-09-06T15:11:42.231402+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:43.400 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/522200642 >> v1:172.21.15.190:6789/0 conn(0x7f0bb410a660 legacy=0x7f0bb410cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:43.400 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/522200642 shutdown_connections 2024-09-06T15:11:43.400 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/522200642 >> 172.21.15.190:0/522200642 conn(0x7f0bb40fcd20 msgr2=0x7f0bb40ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:43.400 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/522200642 shutdown_connections 2024-09-06T15:11:43.401 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/522200642 wait complete. 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 Processor -- start 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- start start 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0bb41a2d30 con 0x7f0bb410a660 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0bb41a3f10 con 0x7f0bb406bc50 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0bb41a50f0 con 0x7f0bb41068e0 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb2ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f0bb406bc50 0x7f0bb4197ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:46466/0 (socket says 172.21.15.190:46466) 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb2ffd640 1 -- 172.21.15.190:0/1654397119 learned_addr learned my addr 172.21.15.190:0/1654397119 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879007953 0 0) 0x7f0bb41a3f10 con 0x7f0bb406bc50 2024-09-06T15:11:43.402 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9c003520 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2526860050 0 0) 0x7f0b9c003520 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bb41a3f10 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0ba4001960 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482779874 0 0) 0x7f0bb41a50f0 con 0x7f0bb41068e0 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9c003520 con 0x7f0bb41068e0 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896552790 0 0) 0x7f0bb41a2d30 con 0x7f0bb410a660 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bb41a50f0 con 0x7f0bb410a660 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1396135101 0 0) 0x7f0bb41a3f10 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 >> v1:172.21.15.189:6790/0 conn(0x7f0bb41068e0 legacy=0x7f0bb419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 >> v1:172.21.15.189:6789/0 conn(0x7f0bb410a660 legacy=0x7f0bb41a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb41a62d0 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb41a5320 con 0x7f0bb406bc50 2024-09-06T15:11:43.403 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0bb41a5900 con 0x7f0bb406bc50 2024-09-06T15:11:43.404 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f0ba4003a80 con 0x7f0bb406bc50 2024-09-06T15:11:43.404 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.403+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0ba4005be0 con 0x7f0bb406bc50 2024-09-06T15:11:43.404 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.407+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba00050b0 con 0x7f0bb406bc50 2024-09-06T15:11:43.404 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.407+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f0ba40035f0 con 0x7f0bb406bc50 2024-09-06T15:11:43.404 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.407+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(45..45 src has 1..45) ==== 3703+0+0 (unknown 1120365074 0 0) 0x7f0ba40944f0 con 0x7f0bb406bc50 2024-09-06T15:11:43.408 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.411+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f0ba405ddb0 con 0x7f0bb406bc50 2024-09-06T15:11:43.580 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:11:43.583+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ba0000bc0 con 0x7f0b9c078470 2024-09-06T15:11:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[22757]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:44.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:43 smithi189 bash[29727]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:44.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.593415+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-06T15:11:44.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.599250+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-06T15:11:44.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:44.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:43 smithi190 bash[24979]: audit 2024-09-06T15:11:43.600617+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:45.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[22757]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[22757]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[22757]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:45.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[22757]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:45.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[29727]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[29727]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[29727]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:45.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:44 smithi189 bash[29727]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:45.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:44 smithi190 bash[24979]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:44 smithi190 bash[24979]: audit 2024-09-06T15:11:43.586956+0000 mgr.y (mgr.14146) 306 : audit [DBG] from='client.24322 v1:172.21.15.190:0/1654397119' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi190:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:11:45.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:44 smithi190 bash[24979]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:45.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:44 smithi190 bash[24979]: cluster 2024-09-06T15:11:44.232026+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:46 smithi189 bash[29727]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:46 smithi189 bash[29727]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:46 smithi189 bash[22757]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:46 smithi189 bash[22757]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:46 smithi190 bash[24979]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:46.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:46 smithi190 bash[24979]: cluster 2024-09-06T15:11:46.232625+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:48 smithi189 bash[22757]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:48 smithi189 bash[22757]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:48 smithi189 bash[29727]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:48 smithi189 bash[29727]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:48 smithi190 bash[24979]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:48.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:48 smithi190 bash[24979]: cluster 2024-09-06T15:11:48.233332+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:50 smithi190 bash[24979]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:50 smithi190 bash[24979]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:50 smithi189 bash[22757]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:50 smithi189 bash[22757]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:50 smithi189 bash[29727]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:50.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:50 smithi189 bash[29727]: cluster 2024-09-06T15:11:50.234067+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:52 smithi189 bash[22757]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:52 smithi189 bash[22757]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:52 smithi189 bash[29727]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:52 smithi189 bash[29727]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:52 smithi190 bash[24979]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:52.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:52 smithi190 bash[24979]: cluster 2024-09-06T15:11:52.234827+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:53.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[29727]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:53.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:53.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:53 smithi189 bash[22757]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:53.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.394072+0000 mon.a (mon.0) 625 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.394617+0000 mon.b (mon.1) 23 : audit [INF] from='client.? v1:172.21.15.190:0/4120431197' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.397469+0000 mon.a (mon.0) 626 : audit [INF] from='client.24328 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46d1d9ea-f721-4edf-9377-0c7bea4ea700"}]': finished 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: cluster 2024-09-06T15:11:52.403088+0000 mon.a (mon.0) 627 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:52.403557+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:53.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:53 smithi190 bash[24979]: audit 2024-09-06T15:11:53.013453+0000 mon.b (mon.1) 24 : audit [DBG] from='client.? v1:172.21.15.190:0/459745461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-06T15:11:54.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:54 smithi189 bash[22757]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:54.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:54 smithi189 bash[22757]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:54.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:54 smithi189 bash[29727]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:54.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:54 smithi189 bash[29727]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:54.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:54 smithi190 bash[24979]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:54.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:54 smithi190 bash[24979]: cluster 2024-09-06T15:11:54.235544+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:56 smithi189 bash[22757]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:56 smithi189 bash[22757]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:56 smithi189 bash[29727]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:56 smithi189 bash[29727]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:56 smithi190 bash[24979]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:56.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:56 smithi190 bash[24979]: cluster 2024-09-06T15:11:56.236278+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:58 smithi189 bash[22757]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:11:58 smithi189 bash[22757]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:58 smithi189 bash[29727]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:11:58 smithi189 bash[29727]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:58 smithi190 bash[24979]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:11:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:11:58 smithi190 bash[24979]: cluster 2024-09-06T15:11:58.237008+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:00 smithi189 bash[22757]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:00 smithi189 bash[22757]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:00 smithi189 bash[29727]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:00 smithi189 bash[29727]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:00 smithi190 bash[24979]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:00.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:00 smithi190 bash[24979]: cluster 2024-09-06T15:12:00.237762+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:02 smithi190 bash[24979]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:02 smithi190 bash[24979]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:02 smithi189 bash[22757]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:02 smithi189 bash[22757]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:02 smithi189 bash[29727]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:02.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:02 smithi189 bash[29727]: cluster 2024-09-06T15:12:02.238510+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.594 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:04 smithi189 bash[22757]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.595 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:04 smithi189 bash[22757]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:04 smithi190 bash[24979]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:04 smithi190 bash[24979]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:04 smithi189 bash[29727]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:04.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:04 smithi189 bash[29727]: cluster 2024-09-06T15:12:04.239249+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:05 smithi189 bash[22757]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:05 smithi189 bash[22757]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[22757]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[22757]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[29727]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[29727]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[29727]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:06.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:06 smithi189 bash[29727]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:06.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:06 smithi190 bash[24979]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:06 smithi190 bash[24979]: audit 2024-09-06T15:12:05.946081+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-06T15:12:06.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:06 smithi190 bash[24979]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:06.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:06 smithi190 bash[24979]: audit 2024-09-06T15:12:05.947772+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[29727]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[29727]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[29727]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[29727]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[22757]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[22757]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[22757]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:07.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:07 smithi189 bash[22757]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:07.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:07 smithi190 bash[24979]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:07 smithi190 bash[24979]: cephadm 2024-09-06T15:12:05.949061+0000 mgr.y (mgr.14146) 318 : cephadm [INF] Deploying daemon osd.7 on smithi190 2024-09-06T15:12:07.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:07 smithi190 bash[24979]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:07.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:07 smithi190 bash[24979]: cluster 2024-09-06T15:12:06.239905+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:08 smithi189 bash[22757]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:08 smithi189 bash[22757]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:08 smithi189 bash[29727]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:08 smithi189 bash[29727]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:08 smithi190 bash[24979]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:08.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:08 smithi190 bash[24979]: cluster 2024-09-06T15:12:08.240489+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.561 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:10 smithi190 bash[24979]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.561 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:10 smithi190 bash[24979]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.561 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:10.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:10 smithi189 bash[22757]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:10 smithi189 bash[22757]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:10 smithi189 bash[29727]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:10 smithi189 bash[29727]: cluster 2024-09-06T15:12:10.241102+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:10.812 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:10.813 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:10.813 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:10.813 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.124 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.124 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.124 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.125 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:11.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[22757]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:11 smithi189 bash[29727]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.981444+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.991168+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:11.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:11 smithi190 bash[24979]: audit 2024-09-06T15:12:10.999996+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:12.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:12 smithi190 bash[24979]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:12.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:12 smithi190 bash[24979]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:12.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:12 smithi189 bash[29727]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:12.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:12 smithi189 bash[29727]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:12.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:12 smithi189 bash[22757]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:12.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:12 smithi189 bash[22757]: cluster 2024-09-06T15:12:12.241694+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:14 smithi189 bash[29727]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:14 smithi189 bash[29727]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:14 smithi189 bash[22757]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:14 smithi189 bash[22757]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:14 smithi190 bash[24979]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:14.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:14 smithi190 bash[24979]: cluster 2024-09-06T15:12:14.242293+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:16 smithi189 bash[29727]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:16 smithi189 bash[29727]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:16 smithi189 bash[22757]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:16 smithi189 bash[22757]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:16 smithi190 bash[24979]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:16.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:16 smithi190 bash[24979]: cluster 2024-09-06T15:12:16.242913+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:18.874 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:18.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:18.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:18.875 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:18 smithi190 bash[24979]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:19.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[22757]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.698474+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.707532+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.709663+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:19.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.711328+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:19.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: audit 2024-09-06T15:12:17.721722+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:19.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:19.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:18 smithi189 bash[29727]: cluster 2024-09-06T15:12:18.243462+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.462 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.462 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.462 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.463 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.463 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.463 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:20 smithi190 bash[24979]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[22757]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: audit 2024-09-06T15:12:20.220889+0000 mon.a (mon.0) 639 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: audit 2024-09-06T15:12:20.221810+0000 mon.b (mon.1) 25 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-06T15:12:20.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:20.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:20 smithi189 bash[29727]: cluster 2024-09-06T15:12:20.244064+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:21.593 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.594+0000 7f0b9bfff640 1 -- 172.21.15.190:0/1654397119 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (unknown 0 0 2651111038) 0x7f0ba0000bc0 con 0x7f0b9c078470 2024-09-06T15:12:21.593 INFO:teuthology.orchestra.run.smithi190.stdout:Created osd(s) 7 on host 'smithi190' 2024-09-06T15:12:21.596 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 >> v1:172.21.15.189:6800/4002094494 conn(0x7f0b9c078470 legacy=0x7f0b9c07a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:21.596 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 >> v1:172.21.15.190:6789/0 conn(0x7f0bb406bc50 legacy=0x7f0bb4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:21.596 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 shutdown_connections 2024-09-06T15:12:21.596 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 >> 172.21.15.190:0/1654397119 conn(0x7f0bb40fcd20 msgr2=0x7f0bb410cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:21.596 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 shutdown_connections 2024-09-06T15:12:21.597 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:21.598+0000 7f0bb94c4640 1 -- 172.21.15.190:0/1654397119 wait complete. 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[22757]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:21 smithi189 bash[29727]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.610 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.610 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.273773+0000 mon.a (mon.0) 640 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-06T15:12:21.610 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: cluster 2024-09-06T15:12:20.279421+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.280304+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.283195+0000 mon.b (mon.1) 26 : audit [INF] from='osd.7 v1:172.21.15.190:6812/2054184397' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:21.611 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:21 smithi190 bash[24979]: audit 2024-09-06T15:12:20.291920+0000 mon.a (mon.0) 643 : audit [INF] from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]} : dispatch 2024-09-06T15:12:22.321 DEBUG:teuthology.orchestra.run.smithi190:osd.7> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.7.service 2024-09-06T15:12:22.324 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-06T15:12:22.324 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd stat -f json 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:22.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:22.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:22 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.284710+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi190", "root=default"]}]': finished 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.290947+0000 mon.a (mon.0) 645 : cluster [DBG] osdmap e48: 8 total, 7 up, 8 in 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.292229+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.302469+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.574123+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.584270+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: audit 2024-09-06T15:12:21.593882+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:22.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:22 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.244640+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-06T15:12:23.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:23.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[22757]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:23.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:23 smithi189 bash[29727]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.250905+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:21.251015+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.293636+0000 mon.a (mon.0) 651 : cluster [INF] osd.7 v1:172.21.15.190:6812/2054184397 boot 2024-09-06T15:12:23.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:22.293743+0000 mon.a (mon.0) 652 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-09-06T15:12:23.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: audit 2024-09-06T15:12:22.294112+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:12:23.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:23.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:23 smithi190 bash[24979]: cluster 2024-09-06T15:12:23.294582+0000 mon.a (mon.0) 654 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:24.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:24 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:24.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:24 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:24 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.245309+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v303: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:24.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:24 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:24.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:24 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.296501+0000 mon.a (mon.0) 655 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-09-06T15:12:25.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:25 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:25.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:25 smithi189 bash[22757]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:25.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:25 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:25.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:25 smithi189 bash[29727]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:25.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:25 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:25.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:25 smithi190 bash[24979]: cluster 2024-09-06T15:12:24.297983+0000 mon.a (mon.0) 656 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-06T15:12:26.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:26 smithi189 bash[22757]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:26.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:26 smithi189 bash[22757]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:26.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:26 smithi189 bash[29727]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:26.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:26 smithi189 bash[29727]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:26.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:26 smithi190 bash[24979]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:26.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:26 smithi190 bash[24979]: cluster 2024-09-06T15:12:26.246037+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v305: 1 pgs: 1 remapped; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:27.096 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:12:28.337 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/2653698328 >> v1:172.21.15.189:6789/0 conn(0x7f8a141058e0 legacy=0x7f8a14107cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:28.337 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/2653698328 shutdown_connections 2024-09-06T15:12:28.338 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/2653698328 >> 172.21.15.189:0/2653698328 conn(0x7f8a140fcd50 msgr2=0x7f8a140ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:28.338 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/2653698328 shutdown_connections 2024-09-06T15:12:28.338 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/2653698328 wait complete. 2024-09-06T15:12:28.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 Processor -- start 2024-09-06T15:12:28.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- start start 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8a141a29f0 con 0x7f8a14101460 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8a141a3bf0 con 0x7f8a141058e0 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8a141a4df0 con 0x7f8a14109570 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a12d9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f8a14101460 0x7f8a1406b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:55446/0 (socket says 172.21.15.189:55446) 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a12d9d640 1 -- 172.21.15.189:0/3919592363 learned_addr learned my addr 172.21.15.189:0/3919592363 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1359e640 1 --1- 172.21.15.189:0/3919592363 >> v1:172.21.15.189:6790/0 conn(0x7f8a14109570 0x7f8a141a10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:57696/0 (socket says 172.21.15.189:57696) 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968311512 0 0) 0x7f8a141a4df0 con 0x7f8a14109570 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a00003520 con 0x7f8a14109570 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063299003 0 0) 0x7f8a141a29f0 con 0x7f8a14101460 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a141a4df0 con 0x7f8a14101460 2024-09-06T15:12:28.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2751517805 0 0) 0x7f8a00003520 con 0x7f8a14109570 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a141a29f0 con 0x7f8a14109570 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8a0c001210 con 0x7f8a14109570 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4226136396 0 0) 0x7f8a141a4df0 con 0x7f8a14101460 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a00003520 con 0x7f8a14101460 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8a04001d70 con 0x7f8a14101460 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257728611 0 0) 0x7f8a141a3bf0 con 0x7f8a141058e0 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a141a4df0 con 0x7f8a141058e0 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2927676988 0 0) 0x7f8a141a29f0 con 0x7f8a14109570 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 >> v1:172.21.15.190:6789/0 conn(0x7f8a141058e0 legacy=0x7f8a1419d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 >> v1:172.21.15.189:6789/0 conn(0x7f8a14101460 legacy=0x7f8a1406b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a141a6090 con 0x7f8a14109570 2024-09-06T15:12:28.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a141a2c20 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a141a3250 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f8a0c003a60 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.339+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8a0c005b00 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.343+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40050b0 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.343+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f8a0c0035f0 con 0x7f8a14109570 2024-09-06T15:12:28.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.343+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(51..51 src has 1..51) ==== 3995+0+0 (unknown 3000595457 0 0) 0x7f8a0c094210 con 0x7f8a14109570 2024-09-06T15:12:28.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.347+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f8a0c05daf0 con 0x7f8a14109570 2024-09-06T15:12:28.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.511+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f89f40053a0 con 0x7f8a14109570 2024-09-06T15:12:28.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a0bfff640 1 -- 172.21.15.189:0/3919592363 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v51) ==== 74+0+130 (unknown 4287931526 0 2141950014) 0x7f8a0c05d3f0 con 0x7f8a14109570 2024-09-06T15:12:28.513 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:12:28.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 >> v1:172.21.15.189:6800/4002094494 conn(0x7f8a00078300 legacy=0x7f8a0007a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:28.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 >> v1:172.21.15.189:6790/0 conn(0x7f8a14109570 legacy=0x7f8a141a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:28.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 shutdown_connections 2024-09-06T15:12:28.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 >> 172.21.15.189:0/3919592363 conn(0x7f8a140fcd50 msgr2=0x7f8a140ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:28.516 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 shutdown_connections 2024-09-06T15:12:28.516 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:28.515+0000 7f8a1913a640 1 -- 172.21.15.189:0/3919592363 wait complete. 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[29727]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[29727]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[29727]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[29727]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[22757]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[22757]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[22757]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:28.526 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:28 smithi189 bash[22757]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:28.590 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:28 smithi190 bash[24979]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.590 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:28 smithi190 bash[24979]: cluster 2024-09-06T15:12:28.246458+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:28.590 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:28 smithi190 bash[24979]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:28.590 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:28 smithi190 bash[24979]: cluster 2024-09-06T15:12:28.296955+0000 mon.a (mon.0) 657 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-06T15:12:29.176 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1725635542,"num_in_osds":8,"osd_in_since":1725635512,"num_remapped_pgs":0} 2024-09-06T15:12:29.177 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T15:12:29.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:29 smithi189 bash[22757]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:29.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:29 smithi189 bash[22757]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:29.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:29 smithi189 bash[29727]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:29.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:29 smithi189 bash[29727]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:29.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:29 smithi190 bash[24979]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:29.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:29 smithi190 bash[24979]: audit 2024-09-06T15:12:28.518829+0000 mon.c (mon.2) 11 : audit [DBG] from='client.? v1:172.21.15.189:0/3919592363' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-06T15:12:30.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:30 smithi190 bash[24979]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:30.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:30 smithi190 bash[24979]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:30.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:30 smithi189 bash[22757]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:30.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:30 smithi189 bash[22757]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:30.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:30 smithi189 bash[29727]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:30.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:30 smithi189 bash[29727]: cluster 2024-09-06T15:12:30.247022+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:33.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:33 smithi190 bash[24979]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cephadm 2024-09-06T15:12:32.102593+0000 mgr.y (mgr.14146) 332 : cephadm [INF] Detected new or changed devices on smithi190 2024-09-06T15:12:33.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.111781+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.123176+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.126199+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.127886+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.129526+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.131153+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:12:33.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cephadm 2024-09-06T15:12:32.132479+0000 mgr.y (mgr.14146) 333 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 4316M 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.142745+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[29727]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.147405+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.604 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.149146+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:33.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: audit 2024-09-06T15:12:32.161292+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:33.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.605 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:33 smithi189 bash[22757]: cluster 2024-09-06T15:12:32.247599+0000 mgr.y (mgr.14146) 334 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-06T15:12:33.954 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:12:34.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:34 smithi189 bash[22757]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:34.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:34 smithi189 bash[22757]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:34.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:34 smithi189 bash[29727]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:34.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:34 smithi189 bash[29727]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:34.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:34 smithi190 bash[24979]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:34.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:34 smithi190 bash[24979]: cluster 2024-09-06T15:12:34.248369+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T15:12:35.147 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- 172.21.15.189:0/2157401217 >> v1:172.21.15.189:6789/0 conn(0x7f59840752a0 legacy=0x7f5984075680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:35.147 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- 172.21.15.189:0/2157401217 shutdown_connections 2024-09-06T15:12:35.147 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- 172.21.15.189:0/2157401217 >> 172.21.15.189:0/2157401217 conn(0x7f59840fe360 msgr2=0x7f5984100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:35.147 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- 172.21.15.189:0/2157401217 shutdown_connections 2024-09-06T15:12:35.148 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- 172.21.15.189:0/2157401217 wait complete. 2024-09-06T15:12:35.148 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 Processor -- start 2024-09-06T15:12:35.148 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- start start 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59841a9800 con 0x7f5984075e50 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59841aaa00 con 0x7f59840752a0 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5988a2b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f59841abc00 con 0x7f59841111e0 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5981d9b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5984075e50 0x7f59841a4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39216/0 (socket says 172.21.15.189:39216) 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5982d9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f59841111e0 0x7f59841a7f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:45324/0 (socket says 172.21.15.189:45324) 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f5981d9b640 1 -- 172.21.15.189:0/3524817699 learned_addr learned my addr 172.21.15.189:0/3524817699 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766594877 0 0) 0x7f59841abc00 con 0x7f59841111e0 2024-09-06T15:12:35.149 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c003520 con 0x7f59841111e0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020206279 0 0) 0x7f59841a9800 con 0x7f5984075e50 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59841abc00 con 0x7f5984075e50 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1143627566 0 0) 0x7f596c003520 con 0x7f59841111e0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59841a9800 con 0x7f59841111e0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f597c001690 con 0x7f59841111e0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.147+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923590366 0 0) 0x7f59841aaa00 con 0x7f59840752a0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c003520 con 0x7f59840752a0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2669621896 0 0) 0x7f59841abc00 con 0x7f5984075e50 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59841aaa00 con 0x7f5984075e50 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5978001900 con 0x7f5984075e50 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1011837904 0 0) 0x7f59841a9800 con 0x7f59841111e0 2024-09-06T15:12:35.150 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 >> v1:172.21.15.190:6789/0 conn(0x7f59840752a0 legacy=0x7f598410f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 >> v1:172.21.15.189:6789/0 conn(0x7f5984075e50 legacy=0x7f59841a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59841acea0 con 0x7f59841111e0 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59841a9a30 con 0x7f59841111e0 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59841a9fe0 con 0x7f59841111e0 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f597c003de0 con 0x7f59841111e0 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f597c005e80 con 0x7f59841111e0 2024-09-06T15:12:35.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59640050b0 con 0x7f59841111e0 2024-09-06T15:12:35.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f597c003970 con 0x7f59841111e0 2024-09-06T15:12:35.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.151+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(51..51 src has 1..51) ==== 3995+0+0 (unknown 3000595457 0 0) 0x7f597c094690 con 0x7f59841111e0 2024-09-06T15:12:35.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.155+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f597c05de30 con 0x7f59841111e0 2024-09-06T15:12:35.313 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.315+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59640053a0 con 0x7f59841111e0 2024-09-06T15:12:35.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.315+0000 7f59737fe640 1 -- 172.21.15.189:0/3524817699 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+11435 (unknown 2362582443 0 314093208) 0x7f597c05d730 con 0x7f59841111e0 2024-09-06T15:12:35.315 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:12:35.315 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":51,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","created":"2024-09-06T15:02:37.979633+0000","modified":"2024-09-06T15:12:24.288814+0000","last_up_change":"2024-09-06T15:12:22.284553+0000","last_in_change":"2024-09-06T15:11:52.395223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T15:07:52.507824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d92afed7-3bbd-4d81-ace9-acfee64fc0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":775653131}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":775653131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":775653131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":775653131}]},"public_addr":"172.21.15.189:6801/775653131","cluster_addr":"172.21.15.189:6802/775653131","heartbeat_back_addr":"172.21.15.189:6804/775653131","heartbeat_front_addr":"172.21.15.189:6803/775653131","state":["exists","up"]},{"osd":1,"uuid":"2c5618ea-0301-4c3b-b1be-b5f13141d301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":2081655191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":2081655191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":2081655191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":2081655191}]},"public_addr":"172.21.15.189:6805/2081655191","cluster_addr":"172.21.15.189:6806/2081655191","heartbeat_back_addr":"172.21.15.189:6808/2081655191","heartbeat_front_addr":"172.21.15.189:6807/2081655191","state":["exists","up"]},{"osd":2,"uuid":"8f49d03c-eab1-4700-bea3-7a6c5c80a1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":2943648838}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":2943648838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6812","nonce":2943648838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":2943648838}]},"public_addr":"172.21.15.189:6809/2943648838","cluster_addr":"172.21.15.189:6810/2943648838","heartbeat_back_addr":"172.21.15.189:6812/2943648838","heartbeat_front_addr":"172.21.15.189:6811/2943648838","state":["exists","up"]},{"osd":3,"uuid":"4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6813","nonce":3926696354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6814","nonce":3926696354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6816","nonce":3926696354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6815","nonce":3926696354}]},"public_addr":"172.21.15.189:6813/3926696354","cluster_addr":"172.21.15.189:6814/3926696354","heartbeat_back_addr":"172.21.15.189:6816/3926696354","heartbeat_front_addr":"172.21.15.189:6815/3926696354","state":["exists","up"]},{"osd":4,"uuid":"f5ba07bb-3fc6-4137-8006-cee2d487a9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6800","nonce":2144496764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6801","nonce":2144496764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6803","nonce":2144496764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6802","nonce":2144496764}]},"public_addr":"172.21.15.190:6800/2144496764","cluster_addr":"172.21.15.190:6801/2144496764","heartbeat_back_addr":"172.21.15.190:6803/2144496764","heartbeat_front_addr":"172.21.15.190:6802/2144496764","state":["exists","up"]},{"osd":5,"uuid":"30ac143b-0f07-4633-8b54-941c8129c409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6804","nonce":1567707916}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6805","nonce":1567707916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6807","nonce":1567707916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6806","nonce":1567707916}]},"public_addr":"172.21.15.190:6804/1567707916","cluster_addr":"172.21.15.190:6805/1567707916","heartbeat_back_addr":"172.21.15.190:6807/1567707916","heartbeat_front_addr":"172.21.15.190:6806/1567707916","state":["exists","up"]},{"osd":6,"uuid":"ace6a61d-47ae-4d92-83c4-7f49e30714bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6808","nonce":507475988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6809","nonce":507475988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6811","nonce":507475988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6810","nonce":507475988}]},"public_addr":"172.21.15.190:6808/507475988","cluster_addr":"172.21.15.190:6809/507475988","heartbeat_back_addr":"172.21.15.190:6811/507475988","heartbeat_front_addr":"172.21.15.190:6810/507475988","state":["exists","up"]},{"osd":7,"uuid":"46d1d9ea-f721-4edf-9377-0c7bea4ea700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6812","nonce":2054184397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6813","nonce":2054184397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6815","nonce":2054184397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6814","nonce":2054184397}]},"public_addr":"172.21.15.190:6812/2054184397","cluster_addr":"172.21.15.190:6813/2054184397","heartbeat_back_addr":"172.21.15.190:6815/2054184397","heartbeat_front_addr":"172.21.15.190:6814/2054184397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:00.300078+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:53.550765+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:07:48.725148+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:08:42.865141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:09:35.611162+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:10:29.520805+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:11:23.112514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:12:21.251019+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:0/3829376948":"2024-09-07T15:03:38.092560+0000","172.21.15.189:6800/1474022696":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/2479859654":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/1750887384":"2024-09-07T15:03:05.048425+0000","172.21.15.189:6800/843694021":"2024-09-07T15:03:05.048425+0000","172.21.15.189:0/1510466136":"2024-09-07T15:03:05.048425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 >> v1:172.21.15.189:6800/4002094494 conn(0x7f596c0782f0 legacy=0x7f596c07a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 >> v1:172.21.15.189:6790/0 conn(0x7f59841111e0 legacy=0x7f59841a7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 shutdown_connections 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 >> 172.21.15.189:0/3524817699 conn(0x7f59840fe360 msgr2=0x7f5984114690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 shutdown_connections 2024-09-06T15:12:35.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:35.319+0000 7f5988a2b640 1 -- 172.21.15.189:0/3524817699 wait complete. 2024-09-06T15:12:35.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:35 smithi189 bash[29727]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:35 smithi189 bash[29727]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:35 smithi189 bash[22757]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:35 smithi189 bash[22757]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:35 smithi190 bash[24979]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:35 smithi190 bash[24979]: audit 2024-09-06T15:12:35.319860+0000 mon.c (mon.2) 12 : audit [DBG] from='client.? v1:172.21.15.189:0/3524817699' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:12:35.925 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-06T15:07:52.507824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-06T15:12:35.926 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-06T15:12:36.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:36 smithi189 bash[22757]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:36.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:36 smithi189 bash[22757]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:36.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:36 smithi189 bash[29727]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:36.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:36 smithi189 bash[29727]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:36.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:36 smithi190 bash[24979]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:36.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:36 smithi190 bash[24979]: cluster 2024-09-06T15:12:36.249029+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:38 smithi189 bash[22757]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:38 smithi189 bash[22757]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:38 smithi189 bash[29727]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:38 smithi189 bash[29727]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:38 smithi190 bash[24979]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:38.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:38 smithi190 bash[24979]: cluster 2024-09-06T15:12:38.249675+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-06T15:12:40.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:40 smithi189 bash[29727]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:40 smithi189 bash[29727]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:40 smithi189 bash[22757]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:40 smithi189 bash[22757]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:40 smithi190 bash[24979]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:40 smithi190 bash[24979]: cluster 2024-09-06T15:12:40.250286+0000 mgr.y (mgr.14146) 338 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:40.708 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/2561336953 >> v1:172.21.15.189:6789/0 conn(0x7f7fdc1036c0 legacy=0x7f7fdc103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/2561336953 shutdown_connections 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/2561336953 >> 172.21.15.189:0/2561336953 conn(0x7f7fdc0fd230 msgr2=0x7f7fdc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/2561336953 shutdown_connections 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/2561336953 wait complete. 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 Processor -- start 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- start start 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7fdc1a7550 con 0x7f7fdc1036c0 2024-09-06T15:12:41.990 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7fdc1a8750 con 0x7f7fdc10f1b0 2024-09-06T15:12:41.991 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f7fdc1a9950 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.991 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fdb7fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f7fdc10b6a0 0x7f7fdc1a2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:42818/0 (socket says 172.21.15.189:42818) 2024-09-06T15:12:41.991 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fdb7fe640 1 -- 172.21.15.189:0/188930781 learned_addr learned my addr 172.21.15.189:0/188930781 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674036691 0 0) 0x7f7fdc1a9950 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc4003520 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067247118 0 0) 0x7f7fdc1a7550 con 0x7f7fdc1036c0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fdc1a9950 con 0x7f7fdc1036c0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2155280630 0 0) 0x7f7fc4003520 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fdc1a7550 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.992 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f7fd00019c0 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292833177 0 0) 0x7f7fdc1a9950 con 0x7f7fdc1036c0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fc4003520 con 0x7f7fdc1036c0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f7fcc0015d0 con 0x7f7fdc1036c0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506324445 0 0) 0x7f7fdc1a8750 con 0x7f7fdc10f1b0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fdc1a9950 con 0x7f7fdc10f1b0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2634066472 0 0) 0x7f7fdc1a7550 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 >> v1:172.21.15.190:6789/0 conn(0x7f7fdc10f1b0 legacy=0x7f7fdc1a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 >> v1:172.21.15.189:6789/0 conn(0x7f7fdc1036c0 legacy=0x7f7fdc10ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fdc1aabf0 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fdc1a7780 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fdc1a7db0 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f7fd0003a60 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f7fd0005c30 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.991+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc80050b0 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.995+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f7fd00035f0 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.995+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(51..51 src has 1..51) ==== 3995+0+0 (unknown 3000595457 0 0) 0x7f7fd0094410 con 0x7f7fdc10b6a0 2024-09-06T15:12:41.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:41.999+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f7fd005dbf0 con 0x7f7fdc10b6a0 2024-09-06T15:12:42.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.155+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7fc8005c70 con 0x7f7fdc10b6a0 2024-09-06T15:12:42.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.155+0000 7f7fd97fa640 1 -- 172.21.15.189:0/188930781 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (unknown 3212932995 0 2170607528) 0x7f7fd005d4f0 con 0x7f7fdc10b6a0 2024-09-06T15:12:42.156 INFO:teuthology.orchestra.run.smithi189.stdout:pg_num: 1 2024-09-06T15:12:42.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 >> v1:172.21.15.189:6800/4002094494 conn(0x7f7fc4078310 legacy=0x7f7fc407a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:42.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 >> v1:172.21.15.189:6790/0 conn(0x7f7fdc10b6a0 legacy=0x7f7fdc1a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:42.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 shutdown_connections 2024-09-06T15:12:42.158 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 >> 172.21.15.189:0/188930781 conn(0x7f7fdc0fd230 msgr2=0x7f7fdc0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:42.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 shutdown_connections 2024-09-06T15:12:42.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:12:42.159+0000 7f7fe25d4640 1 -- 172.21.15.189:0/188930781 wait complete. 2024-09-06T15:12:42.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:42 smithi189 bash[22757]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:42 smithi189 bash[22757]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:42 smithi189 bash[29727]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:42 smithi189 bash[29727]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:42 smithi190 bash[24979]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:42 smithi190 bash[24979]: audit 2024-09-06T15:12:42.161468+0000 mon.c (mon.2) 13 : audit [DBG] from='client.? v1:172.21.15.189:0/188930781' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-06T15:12:42.793 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi189 2024-09-06T15:12:42.794 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi189=foo.a' 2024-09-06T15:12:43.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:43 smithi189 bash[29727]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:43.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:43 smithi189 bash[29727]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:43.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:43 smithi189 bash[22757]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:43.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:43 smithi189 bash[22757]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:43.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:43 smithi190 bash[24979]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:43.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:43 smithi190 bash[24979]: cluster 2024-09-06T15:12:42.250877+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:44 smithi189 bash[29727]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:44 smithi189 bash[29727]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:44 smithi189 bash[22757]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:44 smithi189 bash[22757]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:44 smithi190 bash[24979]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:44.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:44 smithi190 bash[24979]: cluster 2024-09-06T15:12:44.251461+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:46 smithi189 bash[29727]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:46 smithi189 bash[29727]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:46 smithi189 bash[22757]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:46 smithi189 bash[22757]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:46 smithi190 bash[24979]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:46.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:46 smithi190 bash[24979]: cluster 2024-09-06T15:12:46.252059+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:47.564 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:12:48.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:48 smithi189 bash[29727]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:48 smithi189 bash[29727]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:48 smithi189 bash[22757]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:48 smithi189 bash[22757]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:48 smithi190 bash[24979]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:48 smithi190 bash[24979]: cluster 2024-09-06T15:12:48.252673+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/2963265242 >> v1:172.21.15.190:6789/0 conn(0x7fd5281068e0 legacy=0x7fd528108da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/2963265242 shutdown_connections 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/2963265242 >> 172.21.15.190:0/2963265242 conn(0x7fd5280fcd20 msgr2=0x7fd5280ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/2963265242 shutdown_connections 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/2963265242 wait complete. 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 Processor -- start 2024-09-06T15:12:48.807 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- start start 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd5281a2c90 con 0x7fd52810a660 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd5281a3e70 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fd5281a5050 con 0x7fd5281068e0 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd5277fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd52806bc50 0x7fd528197c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:32978/0 (socket says 172.21.15.190:32978) 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd5277fe640 1 -- 172.21.15.190:0/1377644811 learned_addr learned my addr 172.21.15.190:0/1377644811 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644059419 0 0) 0x7fd5281a3e70 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd510003520 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3044068043 0 0) 0x7fd510003520 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5281a3e70 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fd51c0019d0 con 0x7fd52806bc50 2024-09-06T15:12:48.809 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141953214 0 0) 0x7fd5281a2c90 con 0x7fd52810a660 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd510003520 con 0x7fd52810a660 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601232493 0 0) 0x7fd5281a5050 con 0x7fd5281068e0 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5281a2c90 con 0x7fd5281068e0 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1778901634 0 0) 0x7fd5281a3e70 con 0x7fd52806bc50 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 >> v1:172.21.15.189:6790/0 conn(0x7fd5281068e0 legacy=0x7fd52819de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 >> v1:172.21.15.189:6789/0 conn(0x7fd52810a660 legacy=0x7fd5281a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5281a6230 con 0x7fd52806bc50 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5281a5280 con 0x7fd52806bc50 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5281a58b0 con 0x7fd52806bc50 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fd51c001d10 con 0x7fd52806bc50 2024-09-06T15:12:48.810 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.810+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fd51c005c10 con 0x7fd52806bc50 2024-09-06T15:12:48.811 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.814+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5140050b0 con 0x7fd52806bc50 2024-09-06T15:12:48.811 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.814+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7fd51c0038c0 con 0x7fd52806bc50 2024-09-06T15:12:48.811 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.814+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(51..51 src has 1..51) ==== 3995+0+0 (unknown 3000595457 0 0) 0x7fd51c094580 con 0x7fd52806bc50 2024-09-06T15:12:48.815 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.818+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fd51c05dd20 con 0x7fd52806bc50 2024-09-06T15:12:48.989 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:48.990+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}) -- 0x7fd514000bc0 con 0x7fd5100782b0 2024-09-06T15:12:49.003 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.006+0000 7fd524ff9640 1 -- 172.21.15.190:0/1377644811 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (unknown 0 0 1123153589) 0x7fd514000bc0 con 0x7fd5100782b0 2024-09-06T15:12:49.004 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled rgw.foo.a update... 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 >> v1:172.21.15.189:6800/4002094494 conn(0x7fd5100782b0 legacy=0x7fd51007a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 >> v1:172.21.15.190:6789/0 conn(0x7fd52806bc50 legacy=0x7fd528197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 shutdown_connections 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 >> 172.21.15.190:0/1377644811 conn(0x7fd5280fcd20 msgr2=0x7fd5280ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 shutdown_connections 2024-09-06T15:12:49.006 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:49.010+0000 7fd52db6c640 1 -- 172.21.15.190:0/1377644811 wait complete. 2024-09-06T15:12:49.771 DEBUG:teuthology.orchestra.run.smithi189:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@rgw.foo.a.service 2024-09-06T15:12:49.773 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi190 2024-09-06T15:12:49.773 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[29727]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:50.103 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:50 smithi189 bash[22757]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:48.997434+0000 mgr.y (mgr.14146) 343 : audit [DBG] from='client.24367 v1:172.21.15.190:0/1377644811' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi189=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: cephadm 2024-09-06T15:12:49.001043+0000 mgr.y (mgr.14146) 344 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.008584+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.010289+0000 mon.a (mon.0) 669 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.013481+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.015182+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.025365+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.030740+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.033953+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.045685+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: audit 2024-09-06T15:12:49.049586+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:50 smithi190 bash[24979]: cephadm 2024-09-06T15:12:49.051500+0000 mgr.y (mgr.14146) 345 : cephadm [INF] Deploying daemon rgw.foo.a on smithi189 2024-09-06T15:12:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:51 smithi189 bash[22757]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:51 smithi189 bash[22757]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:51 smithi189 bash[29727]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:51 smithi189 bash[29727]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:51 smithi190 bash[24979]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:51 smithi190 bash[24979]: cluster 2024-09-06T15:12:50.253416+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:51.766 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.767 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.768 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.769 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:51.770 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.091 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.091 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.091 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.092 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.092 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: Started Ceph rgw.foo.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:12:52.093 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[22757]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:53 smithi189 bash[29727]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.032480+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.039301+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.043249+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: cephadm 2024-09-06T15:12:52.043885+0000 mgr.y (mgr.14146) 347 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi189=foo.a;count:1 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.047070+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.050942+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.082666+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: cluster 2024-09-06T15:12:52.254148+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:53.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:53 smithi190 bash[24979]: audit 2024-09-06T15:12:52.754432+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:54.535 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:12:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[22757]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:55 smithi189 bash[29727]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: cluster 2024-09-06T15:12:54.064767+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-09-06T15:12:55.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: audit 2024-09-06T15:12:54.071565+0000 mon.c (mon.2) 14 : audit [INF] from='client.? v1:172.21.15.189:0/2076678603' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: audit 2024-09-06T15:12:54.072303+0000 mon.a (mon.0) 685 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"} : dispatch 2024-09-06T15:12:55.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.377 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:55 smithi190 bash[24979]: cluster 2024-09-06T15:12:54.255097+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v320: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:55.998+0000 7efd18af6640 1 -- 172.21.15.190:0/553097577 >> v1:172.21.15.190:6789/0 conn(0x7efd14102560 legacy=0x7efd14102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:55.998+0000 7efd18af6640 1 -- 172.21.15.190:0/553097577 shutdown_connections 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:55.998+0000 7efd18af6640 1 -- 172.21.15.190:0/553097577 >> 172.21.15.190:0/553097577 conn(0x7efd140fde30 msgr2=0x7efd14100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:55.998+0000 7efd18af6640 1 -- 172.21.15.190:0/553097577 shutdown_connections 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:55.998+0000 7efd18af6640 1 -- 172.21.15.190:0/553097577 wait complete. 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 Processor -- start 2024-09-06T15:12:55.998 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- start start 2024-09-06T15:12:55.999 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efd141a2ce0 con 0x7efd14102560 2024-09-06T15:12:55.999 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efd141a3ec0 con 0x7efd141069e0 2024-09-06T15:12:55.999 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7efd141a50a0 con 0x7efd1410a670 2024-09-06T15:12:55.999 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0bfff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7efd141069e0 0x7efd1419de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:45624/0 (socket says 172.21.15.190:45624) 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0bfff640 1 -- 172.21.15.190:0/110612613 learned_addr learned my addr 172.21.15.190:0/110612613 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259928977 0 0) 0x7efd141a3ec0 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd00003520 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 862668393 0 0) 0x7efd00003520 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd141a3ec0 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7efcfc0019d0 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52574960 0 0) 0x7efd141a50a0 con 0x7efd1410a670 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd00003520 con 0x7efd1410a670 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228282304 0 0) 0x7efd141a2ce0 con 0x7efd14102560 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd141a50a0 con 0x7efd14102560 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3063837583 0 0) 0x7efd141a3ec0 con 0x7efd141069e0 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 >> v1:172.21.15.189:6790/0 conn(0x7efd1410a670 legacy=0x7efd141a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:56.000 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 >> v1:172.21.15.189:6789/0 conn(0x7efd14102560 legacy=0x7efd14197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd141a6280 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd141a5270 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efd141a58a0 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7efcfc001c90 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7efcfc005c50 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf40050b0 con 0x7efd141069e0 2024-09-06T15:12:56.001 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.002+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7efcfc0038c0 con 0x7efd141069e0 2024-09-06T15:12:56.002 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.006+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(53..53 src has 1..53) ==== 4354+0+0 (unknown 1602240728 0 0) 0x7efcfc094690 con 0x7efd141069e0 2024-09-06T15:12:57.817 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.818 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.818 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.818 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.818 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.818 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[22757]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.818 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.010+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7efcfc05dcc0 con 0x7efd141069e0 2024-09-06T15:12:57.819 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:56.182+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) -- 0x7efcf40053a0 con 0x7efd141069e0 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:56 smithi189 bash[29727]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[29727]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.820 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: cluster 2024-09-06T15:12:55.057382+0000 mon.a (mon.0) 686 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: audit 2024-09-06T15:12:55.067197+0000 mon.a (mon.0) 687 : audit [INF] from='client.24368 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:56 smithi190 bash[24979]: cluster 2024-09-06T15:12:55.077219+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.821 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.822 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:57 smithi189 bash[22757]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.082+0000 7efd0b7fe640 1 -- 172.21.15.190:0/110612613 <== mon.1 v1:172.21.15.190:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v55) ==== 160+0+0 (unknown 3715638899 0 0) 0x7efcfc05d5c0 con 0x7efd141069e0 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:pool 'datapool' created 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.090+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 >> v1:172.21.15.189:6800/4002094494 conn(0x7efd00078430 legacy=0x7efd0007a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.090+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 >> v1:172.21.15.190:6789/0 conn(0x7efd141069e0 legacy=0x7efd1419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.090+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 shutdown_connections 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.090+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 >> 172.21.15.190:0/110612613 conn(0x7efd140fde30 msgr2=0x7efd14100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.094+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 shutdown_connections 2024-09-06T15:12:57.823 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:12:57.094+0000 7efd18af6640 1 -- 172.21.15.190:0/110612613 wait complete. 2024-09-06T15:12:57.823 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: cluster 2024-09-06T15:12:56.077557+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.095843+0000 mon.c (mon.2) 15 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.096792+0000 mon.a (mon.0) 690 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.188091+0000 mon.a (mon.0) 691 : audit [INF] from='client.24391 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: audit 2024-09-06T15:12:56.189059+0000 mon.b (mon.1) 27 : audit [INF] from='client.? v1:172.21.15.190:0/110612613' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} : dispatch 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.824 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:57 smithi190 bash[24979]: cluster 2024-09-06T15:12:56.255879+0000 mgr.y (mgr.14146) 350 : cluster [DBG] pgmap v323: 65 pgs: 8 creating+peering, 52 unknown, 5 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:12:57.836 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- rbd pool init datapool 2024-09-06T15:12:58.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.376 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:58 smithi190 bash[24979]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.073192+0000 mon.a (mon.0) 692 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.073387+0000 mon.a (mon.0) 693 : audit [INF] from='client.24391 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: cluster 2024-09-06T15:12:57.082348+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.469724+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.475203+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.476093+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:57.476806+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: cluster 2024-09-06T15:12:58.090141+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.093844+0000 mon.c (mon.2) 16 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[22757]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.094813+0000 mon.a (mon.0) 700 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.101754+0000 mon.c (mon.2) 17 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:58.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:58 smithi189 bash[29727]: audit 2024-09-06T15:12:58.103219+0000 mon.a (mon.0) 701 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"} : dispatch 2024-09-06T15:12:59.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:12:59.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:12:59 smithi190 bash[24979]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:12:59.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:12:59.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[22757]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cephadm 2024-09-06T15:12:57.481592+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cluster 2024-09-06T15:12:58.256820+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v326: 100 pgs: 1 creating+activating, 16 creating+peering, 48 unknown, 35 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: audit 2024-09-06T15:12:59.079752+0000 mon.a (mon.0) 702 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: audit 2024-09-06T15:12:59.079934+0000 mon.a (mon.0) 703 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:12:59.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:12:59 smithi189 bash[29727]: cluster 2024-09-06T15:12:59.087659+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[22757]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:01.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:01 smithi189 bash[29727]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:01.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: cluster 2024-09-06T15:13:00.092206+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-06T15:13:01.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.102403+0000 mon.c (mon.2) 18 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.103377+0000 mon.c (mon.2) 19 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.103861+0000 mon.a (mon.0) 706 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: audit 2024-09-06T15:13:00.105081+0000 mon.a (mon.0) 707 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"} : dispatch 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:01.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:01 smithi190 bash[24979]: cluster 2024-09-06T15:13:00.257634+0000 mgr.y (mgr.14146) 353 : cluster [DBG] pgmap v329: 132 pgs: 1 creating+activating, 12 creating+peering, 54 unknown, 65 active+clean; 578 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-09-06T15:13:02.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.375 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:02 smithi190 bash[24979]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[22757]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.092283+0000 mon.a (mon.0) 708 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.092448+0000 mon.a (mon.0) 709 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: cluster 2024-09-06T15:13:01.103219+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.110037+0000 mon.c (mon.2) 20 : audit [INF] from='client.? v1:172.21.15.189:0/4268207925' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.111081+0000 mon.c (mon.2) 21 : audit [INF] from='client.? v1:172.21.15.189:0/2831970096' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.115275+0000 mon.a (mon.0) 711 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:02 smithi189 bash[29727]: audit 2024-09-06T15:13:01.115692+0000 mon.a (mon.0) 712 : audit [INF] from='client.24413 ' entity='mgr.y' cmd={"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"} : dispatch 2024-09-06T15:13:02.602 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.380 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.381 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:03 smithi190 bash[24979]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.094775+0000 mon.a (mon.0) 713 : audit [INF] from='client.24377 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.094939+0000 mon.a (mon.0) 714 : audit [INF] from='client.24413 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: cluster 2024-09-06T15:13:02.101331+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: cluster 2024-09-06T15:13:02.258238+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v332: 132 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 95 active+clean; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.372842+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.377987+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.389314+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.437320+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.438899+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[22757]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.439604+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:03 smithi189 bash[29727]: audit 2024-09-06T15:13:02.697028+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:04.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:04 smithi190 bash[24979]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:04 smithi190 bash[24979]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:04 smithi190 bash[24979]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:04.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:04 smithi190 bash[24979]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:04.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[22757]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[22757]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[22757]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:04.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[22757]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:04.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[29727]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[29727]: cephadm 2024-09-06T15:13:02.444437+0000 mgr.y (mgr.14146) 355 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-06T15:13:04.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[29727]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:04.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:04 smithi189 bash[29727]: cluster 2024-09-06T15:13:03.104378+0000 mon.a (mon.0) 723 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T15:13:05.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:05.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:05 smithi190 bash[24979]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:05.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[22757]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: audit 2024-09-06T15:13:04.163182+0000 mon.a (mon.0) 724 : audit [INF] from='client.24469 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: audit 2024-09-06T15:13:04.164343+0000 mon.b (mon.1) 28 : audit [INF] from='client.? v1:172.21.15.190:0/2064414160' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "datapool","app": "rbd"} : dispatch 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:05.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:05 smithi189 bash[29727]: cluster 2024-09-06T15:13:04.259678+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v333: 132 pgs: 2 creating+peering, 7 unknown, 123 active+clean; 580 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 40 KiB/s rd, 4.1 KiB/s wr, 96 op/s 2024-09-06T15:13:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[22757]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[22757]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[22757]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[22757]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[29727]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[29727]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[29727]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:06.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:06 smithi189 bash[29727]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:06.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:06 smithi190 bash[24979]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:06 smithi190 bash[24979]: audit 2024-09-06T15:13:05.127635+0000 mon.a (mon.0) 725 : audit [INF] from='client.24469 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-06T15:13:06.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:06 smithi190 bash[24979]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:06.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:06 smithi190 bash[24979]: cluster 2024-09-06T15:13:05.134370+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-06T15:13:07.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[22757]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.655 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[22757]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.655 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[22757]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.655 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[22757]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:07 smithi190 bash[24979]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:07 smithi190 bash[24979]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:07 smithi190 bash[24979]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:07 smithi190 bash[24979]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[29727]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[29727]: cluster 2024-09-06T15:13:06.135961+0000 mon.a (mon.0) 727 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-06T15:13:07.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[29727]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:07 smithi189 bash[29727]: cluster 2024-09-06T15:13:06.260452+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 4.8 KiB/s wr, 133 op/s 2024-09-06T15:13:07.909 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.190 --placement '1;smithi190=iscsi.a' 2024-09-06T15:13:08.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:08 smithi190 bash[24979]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:08 smithi190 bash[24979]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:08 smithi190 bash[24979]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:08.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:08 smithi190 bash[24979]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[22757]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[22757]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[22757]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[22757]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[29727]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[29727]: cluster 2024-09-06T15:13:07.140820+0000 mon.a (mon.0) 728 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T15:13:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[29727]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:08 smithi189 bash[29727]: cluster 2024-09-06T15:13:07.162603+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-06T15:13:09.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:09 smithi189 bash[22757]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:09.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:09 smithi189 bash[22757]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:09.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:09 smithi189 bash[29727]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:09.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:09 smithi189 bash[29727]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:09.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:09 smithi190 bash[24979]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:09.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:09 smithi190 bash[24979]: cluster 2024-09-06T15:13:08.261506+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 5.8 KiB/s wr, 188 op/s 2024-09-06T15:13:10.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:10 smithi189 bash[22757]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:10.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:10 smithi189 bash[22757]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:10.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:10 smithi189 bash[29727]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:10.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:10 smithi189 bash[29727]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:10.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:10 smithi190 bash[24979]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:10.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:10 smithi190 bash[24979]: cluster 2024-09-06T15:13:10.262580+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.0 KiB/s wr, 108 op/s 2024-09-06T15:13:12.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:12 smithi189 bash[22757]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:12 smithi189 bash[22757]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:12 smithi189 bash[29727]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:12 smithi189 bash[29727]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:12 smithi190 bash[24979]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:12 smithi190 bash[24979]: cluster 2024-09-06T15:13:12.263608+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 27 KiB/s rd, 1.8 KiB/s wr, 64 op/s 2024-09-06T15:13:12.684 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:14.043 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- 172.21.15.190:0/257229138 >> v1:172.21.15.190:6789/0 conn(0x7f557c102550 legacy=0x7f557c102950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:14.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- 172.21.15.190:0/257229138 shutdown_connections 2024-09-06T15:13:14.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- 172.21.15.190:0/257229138 >> 172.21.15.190:0/257229138 conn(0x7f557c0fde00 msgr2=0x7f557c100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:14.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- 172.21.15.190:0/257229138 shutdown_connections 2024-09-06T15:13:14.044 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- 172.21.15.190:0/257229138 wait complete. 2024-09-06T15:13:14.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 Processor -- start 2024-09-06T15:13:14.045 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- start start 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f557c1a4ee0 con 0x7f557c10a660 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f557c1a60c0 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f5584711640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f557c1a72a0 con 0x7f557c1069d0 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f55824ad640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f557c102550 0x7f557c109610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:40708/0 (socket says 172.21.15.190:40708) 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f55824ad640 1 -- 172.21.15.190:0/2545262093 learned_addr learned my addr 172.21.15.190:0/2545262093 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242022513 0 0) 0x7f557c1a60c0 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.046+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5568003520 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 641736772 0 0) 0x7f5568003520 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f557c1a60c0 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f55780014b0 con 0x7f557c102550 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553494068 0 0) 0x7f557c1a4ee0 con 0x7f557c10a660 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5568003520 con 0x7f557c10a660 2024-09-06T15:13:14.046 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009130466 0 0) 0x7f557c1a72a0 con 0x7f557c1069d0 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f557c1a4ee0 con 0x7f557c1069d0 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 437312513 0 0) 0x7f557c1a60c0 con 0x7f557c102550 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 >> v1:172.21.15.189:6790/0 conn(0x7f557c1069d0 legacy=0x7f557c1a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 >> v1:172.21.15.189:6789/0 conn(0x7f557c10a660 legacy=0x7f557c1a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557c1a8480 con 0x7f557c102550 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f557c1a5110 con 0x7f557c102550 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f557c1a5740 con 0x7f557c102550 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5578003800 con 0x7f557c102550 2024-09-06T15:13:14.047 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5578004cf0 con 0x7f557c102550 2024-09-06T15:13:14.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55600050b0 con 0x7f557c102550 2024-09-06T15:13:14.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 15) ==== 99786+0+0 (unknown 1086804725 0 0) 0x7f5578001960 con 0x7f557c102550 2024-09-06T15:13:14.048 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.050+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(63..63 src has 1..63) ==== 5884+0+0 (unknown 3418519839 0 0) 0x7f5578094e20 con 0x7f557c102550 2024-09-06T15:13:14.052 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.054+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f557805dec0 con 0x7f557c102550 2024-09-06T15:13:14.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.230+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}) -- 0x7f5560000c90 con 0x7f5568078420 2024-09-06T15:13:14.243 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled iscsi.datapool update... 2024-09-06T15:13:14.244 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.246+0000 7f55737fe640 1 -- 172.21.15.190:0/2545262093 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+35 (unknown 0 0 803663096) 0x7f5560000c90 con 0x7f5568078420 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5568078420 legacy=0x7f556807a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 >> v1:172.21.15.190:6789/0 conn(0x7f557c102550 legacy=0x7f557c109610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 shutdown_connections 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 >> 172.21.15.190:0/2545262093 conn(0x7f557c0fde00 msgr2=0x7f557c10d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 shutdown_connections 2024-09-06T15:13:14.246 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:14.250+0000 7f5584711640 1 -- 172.21.15.190:0/2545262093 wait complete. 2024-09-06T15:13:14.978 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-06T15:13:14.978 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:13:14.978 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-06T15:13:14.991 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:13:14.992 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-06T15:13:15.005 DEBUG:teuthology.orchestra.run.smithi190:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@iscsi.iscsi.a.service 2024-09-06T15:13:15.057 INFO:tasks.cephadm:Adding prometheus.a on smithi190 2024-09-06T15:13:15.057 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply prometheus '1;smithi190=a' 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.602 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[22757]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:15 smithi189 bash[29727]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.613 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:15 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.235520+0000 mgr.y (mgr.14146) 361 : audit [DBG] from='client.24475 v1:172.21.15.190:0/2545262093' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.190", "placement": "1;smithi190=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cephadm 2024-09-06T15:13:14.240983+0000 mgr.y (mgr.14146) 362 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi190=iscsi.a;count:1 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.248663+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.613 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.250668+0000 mon.a (mon.0) 731 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cluster 2024-09-06T15:13:14.264885+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 1.6 KiB/s wr, 56 op/s 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: cluster 2024-09-06T15:13:14.422886+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.922555+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.923421+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.930821+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.936731+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]} : dispatch 2024-09-06T15:13:15.614 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.615 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.939409+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-06T15:13:15.615 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:15.615 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:15 smithi190 bash[24979]: audit 2024-09-06T15:13:14.960720+0000 mon.a (mon.0) 738 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:16.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:16 smithi189 bash[22757]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:16.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:16 smithi189 bash[22757]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:16.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:16 smithi189 bash[29727]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:16.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:16 smithi189 bash[29727]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:16.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:16 smithi190 bash[24979]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:16.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:16 smithi190 bash[24979]: cephadm 2024-09-06T15:13:14.962198+0000 mgr.y (mgr.14146) 364 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi190 2024-09-06T15:13:17.545 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:17 smithi190 bash[24979]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.545 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:17 smithi190 bash[24979]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:17 smithi189 bash[22757]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:17 smithi189 bash[22757]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:17 smithi189 bash[29727]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:17 smithi189 bash[29727]: cluster 2024-09-06T15:13:16.266023+0000 mgr.y (mgr.14146) 365 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 5.9 KiB/s rd, 224 B/s wr, 13 op/s 2024-09-06T15:13:17.795 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.796 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.796 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.796 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.797 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.797 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:17.797 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.046 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.047 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.047 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.047 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.047 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.048 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.048 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.048 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.048 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:17 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:18.048 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:18 smithi190 systemd[1]: Started Ceph iscsi.iscsi.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.374 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:19 smithi190 bash[24979]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[22757]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.113526+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.127428+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.137685+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: cephadm 2024-09-06T15:13:18.138814+0000 mgr.y (mgr.14146) 366 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.153866+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: audit 2024-09-06T15:13:18.187868+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:19.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:19 smithi189 bash[29727]: cluster 2024-09-06T15:13:18.267208+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:19.858 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:20.623 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug Started the configuration object watcher 2024-09-06T15:13:20.623 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug Checking for config object changes every 1s 2024-09-06T15:13:20.623 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug Processing osd blocklist entries for this node 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug Reading the configuration object to update local LIO configuration 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug Configuration does not have an entry for this host(smithi190.front.sepia.ceph.com) - nothing to define to LIO 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: * Environment: production 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: Use a production WSGI server instead. 2024-09-06T15:13:21.123 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: * Debug mode: off 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug * Running on all addresses. 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: * Running on all addresses. 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: debug * Running on http://[fe80::ec4:7aff:fe88:7763]:5000/ (Press CTRL+C to quit) 2024-09-06T15:13:21.124 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:20 smithi190 bash[49459]: * Running on http://[fe80::ec4:7aff:fe88:7763]:5000/ (Press CTRL+C to quit) 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3182671433 >> v1:172.21.15.190:6789/0 conn(0x7f682810a660 legacy=0x7f682810cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3182671433 shutdown_connections 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3182671433 >> 172.21.15.190:0/3182671433 conn(0x7f68280fcd20 msgr2=0x7f68280ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3182671433 shutdown_connections 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3182671433 wait complete. 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 Processor -- start 2024-09-06T15:13:21.491 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- start start 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f68281a4dc0 con 0x7f682810a660 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f68281a5fc0 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f68281a71c0 con 0x7f682806bb90 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6826ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6828106910 0x7f682819fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:39562/0 (socket says 172.21.15.190:39562) 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6826ffd640 1 -- 172.21.15.190:0/3185164837 learned_addr learned my addr 172.21.15.190:0/3185164837 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103648717 0 0) 0x7f68281a5fc0 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6810003520 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1167983501 0 0) 0x7f6810003520 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68281a5fc0 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f681c0019f0 con 0x7f6828106910 2024-09-06T15:13:21.493 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555742584 0 0) 0x7f68281a4dc0 con 0x7f682810a660 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6810003520 con 0x7f682810a660 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804757673 0 0) 0x7f68281a71c0 con 0x7f682806bb90 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68281a4dc0 con 0x7f682806bb90 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2409553143 0 0) 0x7f68281a5fc0 con 0x7f6828106910 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 >> v1:172.21.15.189:6790/0 conn(0x7f682806bb90 legacy=0x7f6828102840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 >> v1:172.21.15.189:6789/0 conn(0x7f682810a660 legacy=0x7f68281a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68281a8460 con 0x7f6828106910 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68281a4ff0 con 0x7f6828106910 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f68281a5620 con 0x7f6828106910 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f681c001cb0 con 0x7f6828106910 2024-09-06T15:13:21.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.494+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f681c005ce0 con 0x7f6828106910 2024-09-06T15:13:21.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.498+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68140050b0 con 0x7f6828106910 2024-09-06T15:13:21.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.498+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 16) ==== 99837+0+0 (unknown 1706157822 0 0) 0x7f681c003f50 con 0x7f6828106910 2024-09-06T15:13:21.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.498+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(64..64 src has 1..64) ==== 5856+0+0 (unknown 2167039935 0 0) 0x7f681c094e50 con 0x7f6828106910 2024-09-06T15:13:21.499 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.502+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f681c05ddd0 con 0x7f6828106910 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[22757]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:21 smithi189 bash[29727]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: cluster 2024-09-06T15:13:20.177575+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: x 2024-09-06T15:13:21.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: cluster 2024-09-06T15:13:20.268275+0000 mgr.y (mgr.14146) 368 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-06T15:13:21.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:21 smithi190 bash[24979]: audit 2024-09-06T15:13:20.664477+0000 mon.b (mon.1) 29 : audit [DBG] from='client.? v1:172.21.15.190:0/3423112716' entity='client.iscsi.iscsi.a' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:13:21.661 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.666+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}) -- 0x7f6814000bc0 con 0x7f68100784a0 2024-09-06T15:13:21.675 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.678+0000 7f6824ff9640 1 -- 172.21.15.190:0/3185164837 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (unknown 0 0 1342662408) 0x7f6814000bc0 con 0x7f68100784a0 2024-09-06T15:13:21.675 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled prometheus update... 2024-09-06T15:13:21.677 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.678+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 >> v1:172.21.15.189:6800/4002094494 conn(0x7f68100784a0 legacy=0x7f681007a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:21.677 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.682+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 >> v1:172.21.15.190:6789/0 conn(0x7f6828106910 legacy=0x7f682819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:21.677 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.682+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 shutdown_connections 2024-09-06T15:13:21.678 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.682+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 >> 172.21.15.190:0/3185164837 conn(0x7f68280fcd20 msgr2=0x7f68280ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:21.678 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.682+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 shutdown_connections 2024-09-06T15:13:21.678 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:21.682+0000 7f682daea640 1 -- 172.21.15.190:0/3185164837 wait complete. 2024-09-06T15:13:22.406 DEBUG:teuthology.orchestra.run.smithi190:prometheus.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@prometheus.a.service 2024-09-06T15:13:22.409 INFO:tasks.cephadm:Adding node-exporter.a on smithi189 2024-09-06T15:13:22.409 INFO:tasks.cephadm:Adding node-exporter.b on smithi190 2024-09-06T15:13:22.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply node-exporter '2;smithi189=a;smithi190=b' 2024-09-06T15:13:23.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[29727]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:23.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:22 smithi189 bash[22757]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: audit 2024-09-06T15:13:21.669878+0000 mgr.y (mgr.14146) 369 : audit [DBG] from='client.24505 v1:172.21.15.190:0/3185164837' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: cephadm 2024-09-06T15:13:21.672943+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Saving service prometheus spec with placement smithi190=a;count:1 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: audit 2024-09-06T15:13:21.680260+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:23.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:22 smithi190 bash[24979]: cluster 2024-09-06T15:13:22.269318+0000 mgr.y (mgr.14146) 371 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:24.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:23 smithi189 bash[22757]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:24.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:23 smithi189 bash[22757]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:24.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:23 smithi189 bash[29727]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:24.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:23 smithi189 bash[29727]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:24.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:23 smithi190 bash[24979]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:24.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:23 smithi190 bash[24979]: audit 2024-09-06T15:13:22.766717+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[22757]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:24 smithi189 bash[29727]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: cluster 2024-09-06T15:13:24.270494+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:25.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: audit 2024-09-06T15:13:24.366876+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:25.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:24 smithi190 bash[24979]: audit 2024-09-06T15:13:24.378128+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[22757]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:25 smithi189 bash[29727]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.122 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:25 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.096908+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.098484+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:25 smithi190 bash[24979]: audit 2024-09-06T15:13:25.110609+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:26.967 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:27.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[22757]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[22757]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[22757]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:27.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[22757]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:27.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[29727]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[29727]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[29727]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:27.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:26 smithi189 bash[29727]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:27.115 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:26 smithi190 bash[24979]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.115 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:26 smithi190 bash[24979]: cephadm 2024-09-06T15:13:25.382675+0000 mgr.y (mgr.14146) 373 : cephadm [INF] Deploying daemon prometheus.a on smithi190 2024-09-06T15:13:27.115 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:26 smithi190 bash[24979]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:27.115 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:26 smithi190 bash[24979]: cluster 2024-09-06T15:13:26.271632+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 431 B/s rd, 86 B/s wr, 1 op/s 2024-09-06T15:13:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:28 smithi189 bash[22757]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:28.601 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:28 smithi189 bash[22757]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:28 smithi189 bash[29727]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:28.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:28 smithi189 bash[29727]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:28.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:28 smithi190 bash[24979]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:28.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:28 smithi190 bash[24979]: cluster 2024-09-06T15:13:28.272763+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:29.902 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3232204669 >> v1:172.21.15.190:6789/0 conn(0x7fe57406b430 legacy=0x7fe574105120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3232204669 shutdown_connections 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3232204669 >> 172.21.15.190:0/3232204669 conn(0x7fe5740fcd10 msgr2=0x7fe5740ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3232204669 shutdown_connections 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3232204669 wait complete. 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 Processor -- start 2024-09-06T15:13:29.903 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- start start 2024-09-06T15:13:29.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5741a4d50 con 0x7fe5741068d0 2024-09-06T15:13:29.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5741a5f50 con 0x7fe57406b430 2024-09-06T15:13:29.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5741a7150 con 0x7fe57410a650 2024-09-06T15:13:29.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe57259c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe57406b430 0x7fe574102770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:49692/0 (socket says 172.21.15.190:49692) 2024-09-06T15:13:29.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe57259c640 1 -- 172.21.15.190:0/3739974241 learned_addr learned my addr 172.21.15.190:0/3739974241 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041901092 0 0) 0x7fe5741a5f50 con 0x7fe57406b430 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe55c003520 con 0x7fe57406b430 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3021599785 0 0) 0x7fe55c003520 con 0x7fe57406b430 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5741a5f50 con 0x7fe57406b430 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531167474 0 0) 0x7fe5741a7150 con 0x7fe57410a650 2024-09-06T15:13:29.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe55c003520 con 0x7fe57410a650 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe5640014b0 con 0x7fe57406b430 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255306035 0 0) 0x7fe5741a4d50 con 0x7fe5741068d0 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5741a7150 con 0x7fe5741068d0 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1369149135 0 0) 0x7fe5741a5f50 con 0x7fe57406b430 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 >> v1:172.21.15.189:6790/0 conn(0x7fe57410a650 legacy=0x7fe5741a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:29.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 >> v1:172.21.15.189:6789/0 conn(0x7fe5741068d0 legacy=0x7fe57419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:29.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5741a83f0 con 0x7fe57406b430 2024-09-06T15:13:29.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe5741a4f80 con 0x7fe57406b430 2024-09-06T15:13:29.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe5741a55b0 con 0x7fe57406b430 2024-09-06T15:13:29.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe564003800 con 0x7fe57406b430 2024-09-06T15:13:29.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.905+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe564004de0 con 0x7fe57406b430 2024-09-06T15:13:29.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.909+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5540050b0 con 0x7fe57406b430 2024-09-06T15:13:29.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.909+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 16) ==== 99837+0+0 (unknown 1706157822 0 0) 0x7fe564001a20 con 0x7fe57406b430 2024-09-06T15:13:29.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.909+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(64..64 src has 1..64) ==== 5856+0+0 (unknown 2167039935 0 0) 0x7fe564094eb0 con 0x7fe57406b430 2024-09-06T15:13:29.912 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:29.913+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe56405de90 con 0x7fe57406b430 2024-09-06T15:13:30.208 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.209+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}) -- 0x7fe554000bc0 con 0x7fe55c080c50 2024-09-06T15:13:30.221 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.221+0000 7fe5637fe640 1 -- 172.21.15.190:0/3739974241 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (unknown 0 0 240551134) 0x7fe554000bc0 con 0x7fe55c080c50 2024-09-06T15:13:30.221 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled node-exporter update... 2024-09-06T15:13:30.223 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 >> v1:172.21.15.189:6800/4002094494 conn(0x7fe55c080c50 legacy=0x7fe55c083110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:30.224 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 >> v1:172.21.15.190:6789/0 conn(0x7fe57406b430 legacy=0x7fe574102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:30.224 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 shutdown_connections 2024-09-06T15:13:30.224 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 >> 172.21.15.190:0/3739974241 conn(0x7fe5740fcd10 msgr2=0x7fe5740ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:30.224 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 shutdown_connections 2024-09-06T15:13:30.224 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:30.225+0000 7fe578aa2640 1 -- 172.21.15.190:0/3739974241 wait complete. 2024-09-06T15:13:30.622 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:30 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:13:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:31.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[22757]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:31.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:31 smithi189 bash[29727]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.188041+0000 mgr.y (mgr.14146) 376 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.216054+0000 mgr.y (mgr.14146) 377 : audit [DBG] from='client.24511 v1:172.21.15.190:0/3739974241' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi189=a;smithi190=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: cephadm 2024-09-06T15:13:30.219179+0000 mgr.y (mgr.14146) 378 : cephadm [INF] Saving service node-exporter spec with placement smithi189=a;smithi190=b;count:2 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: audit 2024-09-06T15:13:30.226248+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:31.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:31 smithi190 bash[24979]: cluster 2024-09-06T15:13:30.273928+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.304 DEBUG:teuthology.orchestra.run.smithi189:node-exporter.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.a.service 2024-09-06T15:13:32.307 DEBUG:teuthology.orchestra.run.smithi190:node-exporter.b> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.b.service 2024-09-06T15:13:32.309 INFO:tasks.cephadm:Adding alertmanager.a on smithi189 2024-09-06T15:13:32.309 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply alertmanager '1;smithi189=a' 2024-09-06T15:13:32.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:32 smithi189 bash[22757]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:32 smithi189 bash[22757]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:32 smithi189 bash[29727]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:32 smithi189 bash[29727]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:32 smithi190 bash[24979]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:32.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:32 smithi190 bash[24979]: cluster 2024-09-06T15:13:32.275125+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:34 smithi189 bash[22757]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:34 smithi189 bash[22757]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:34 smithi189 bash[29727]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:34 smithi189 bash[29727]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:34 smithi190 bash[24979]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:34.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:34 smithi190 bash[24979]: cluster 2024-09-06T15:13:34.276261+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:36 smithi189 bash[22757]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:36 smithi189 bash[22757]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:36 smithi189 bash[29727]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:36 smithi189 bash[29727]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:36 smithi190 bash[24979]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:36.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:36 smithi190 bash[24979]: cluster 2024-09-06T15:13:36.277406+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-06T15:13:37.173 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:38.566 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:38 smithi190 bash[24979]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.566 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:38 smithi190 bash[24979]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:38 smithi189 bash[22757]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:38 smithi189 bash[22757]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:38 smithi189 bash[29727]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:38 smithi189 bash[29727]: audit 2024-09-06T15:13:38.171726+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]} : dispatch 2024-09-06T15:13:38.923 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- 172.21.15.190:0/901142025 >> v1:172.21.15.190:6789/0 conn(0x7f6ac0101440 legacy=0x7f6ac0101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:38.923 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- 172.21.15.190:0/901142025 shutdown_connections 2024-09-06T15:13:38.923 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- 172.21.15.190:0/901142025 >> 172.21.15.190:0/901142025 conn(0x7f6ac00fcd10 msgr2=0x7f6ac00ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:38.923 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- 172.21.15.190:0/901142025 shutdown_connections 2024-09-06T15:13:38.924 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- 172.21.15.190:0/901142025 wait complete. 2024-09-06T15:13:38.925 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 Processor -- start 2024-09-06T15:13:38.925 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- start start 2024-09-06T15:13:38.925 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6ac01a4e50 con 0x7f6ac01058c0 2024-09-06T15:13:38.925 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6ac01a6030 con 0x7f6ac0109550 2024-09-06T15:13:38.925 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac62bb640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6ac01a7210 con 0x7f6ac0101440 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac4858640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6ac0109550 0x7f6ac01a3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:49710/0 (socket says 172.21.15.190:49710) 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6ac4858640 1 -- 172.21.15.190:0/1358066609 learned_addr learned my addr 172.21.15.190:0/1358066609 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592868351 0 0) 0x7f6ac01a6030 con 0x7f6ac0109550 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.925+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8003520 con 0x7f6ac0109550 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604919597 0 0) 0x7f6ac01a7210 con 0x7f6ac0101440 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac01a6030 con 0x7f6ac0101440 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443919517 0 0) 0x7f6ac01a4e50 con 0x7f6ac01058c0 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac01a7210 con 0x7f6ac01058c0 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2890990038 0 0) 0x7f6aa8003520 con 0x7f6ac0109550 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ac01a4e50 con 0x7f6ac0109550 2024-09-06T15:13:38.926 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6ab8001c60 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1728997676 0 0) 0x7f6ac01a4e50 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 >> v1:172.21.15.189:6790/0 conn(0x7f6ac0101440 legacy=0x7f6ac019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 >> v1:172.21.15.189:6789/0 conn(0x7f6ac01058c0 legacy=0x7f6ac01a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac01a83f0 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac01a5080 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ac01a56b0 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f6ab8003e00 con 0x7f6ac0109550 2024-09-06T15:13:38.927 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6ab8005fd0 con 0x7f6ac0109550 2024-09-06T15:13:38.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac0050b0 con 0x7f6ac0109550 2024-09-06T15:13:38.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 16) ==== 99837+0+0 (unknown 1706157822 0 0) 0x7f6ab8003990 con 0x7f6ac0109550 2024-09-06T15:13:38.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.929+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(65..65 src has 1..65) ==== 5857+0+0 (unknown 2370804903 0 0) 0x7f6ab8095180 con 0x7f6ac0109550 2024-09-06T15:13:38.931 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:38.933+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f6ab805e0f0 con 0x7f6ac0109550 2024-09-06T15:13:39.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.109+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}) -- 0x7f6aac000bc0 con 0x7f6aa8078330 2024-09-06T15:13:39.121 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled alertmanager update... 2024-09-06T15:13:39.121 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6abd7fa640 1 -- 172.21.15.190:0/1358066609 <== mgr.14146 v1:172.21.15.189:6800/4002094494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (unknown 0 0 1850065467) 0x7f6aac000bc0 con 0x7f6aa8078330 2024-09-06T15:13:39.123 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 >> v1:172.21.15.189:6800/4002094494 conn(0x7f6aa8078330 legacy=0x7f6aa807a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:39.123 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 >> v1:172.21.15.190:6789/0 conn(0x7f6ac0109550 legacy=0x7f6ac01a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:39.123 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 shutdown_connections 2024-09-06T15:13:39.123 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 >> 172.21.15.190:0/1358066609 conn(0x7f6ac00fcd10 msgr2=0x7f6ac010c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:39.124 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 shutdown_connections 2024-09-06T15:13:39.124 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:39.125+0000 7f6ac62bb640 1 -- 172.21.15.190:0/1358066609 wait complete. 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.593 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.594 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:39.594 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:39 smithi190 bash[24979]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[22757]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: audit 2024-09-06T15:13:38.224626+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]': finished 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: cluster 2024-09-06T15:13:38.231518+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: cluster 2024-09-06T15:13:38.278260+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-09-06T15:13:39.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:39.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:39 smithi189 bash[29727]: audit 2024-09-06T15:13:39.126032+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:40.488 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:13:40.488 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.488 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.488 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.488 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.488 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:40.489 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:40 smithi190 bash[24979]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:40.490 DEBUG:teuthology.orchestra.run.smithi189:alertmanager.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@alertmanager.a.service 2024-09-06T15:13:40.493 INFO:tasks.cephadm:Adding grafana.a on smithi190 2024-09-06T15:13:40.493 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph orch apply grafana '1;smithi190=a' 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[22757]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:40.501 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: audit 2024-09-06T15:13:39.114830+0000 mgr.y (mgr.14146) 384 : audit [DBG] from='client.24517 v1:172.21.15.190:0/1358066609' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi189=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:13:40.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: cephadm 2024-09-06T15:13:39.118021+0000 mgr.y (mgr.14146) 385 : cephadm [INF] Saving service alertmanager spec with placement smithi189=a;count:1 2024-09-06T15:13:40.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:40.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:40 smithi189 bash[29727]: cluster 2024-09-06T15:13:39.237291+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-06T15:13:41.509 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:41 smithi190 bash[24979]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:41.509 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:41 smithi190 bash[24979]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:41.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:41 smithi189 bash[22757]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:41.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:41 smithi189 bash[22757]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:41.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:41 smithi189 bash[29727]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:41.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:41 smithi189 bash[29727]: audit 2024-09-06T15:13:40.198919+0000 mgr.y (mgr.14146) 386 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:13:42.436 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.436 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:42 smithi190 bash[24979]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:42 smithi190 bash[24979]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.437 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.437 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.438 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.438 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.438 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:42 smithi189 bash[22757]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:42 smithi189 bash[22757]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:42 smithi189 bash[29727]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:42 smithi189 bash[29727]: cluster 2024-09-06T15:13:40.279300+0000 mgr.y (mgr.14146) 387 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:42.689 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.689 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.689 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.690 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: Started Ceph prometheus.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:13:42.691 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.691 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:42.691 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:42 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:43.999 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[25843]: ignoring --setuser ceph since I am not root 2024-09-06T15:13:43.999 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[25843]: ignoring --setgroup ceph since I am not root 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.000 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.001 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:43 smithi190 bash[24979]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[23007]: ignoring --setuser ceph since I am not root 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[23007]: ignoring --setgroup ceph since I am not root 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[29727]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: cluster 2024-09-06T15:13:42.280419+0000 mgr.y (mgr.14146) 388 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.750600+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.760000+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.767725+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.772104+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:43 smithi189 bash[22757]: audit 2024-09-06T15:13:42.778229+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.007Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.007Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.007Z caller=main.go:623 level=info host_details="(Linux 5.15.0-119-generic #129-Ubuntu SMP Fri Aug 2 19:25:20 UTC 2024 x86_64 smithi190 (none))" 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.007Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.007Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-06T15:13:44.373 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.010Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.010Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.011Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.011Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.015Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.015Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.353µs 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.015Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.015Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.015Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=46.65µs wal_replay_duration=476.793µs wbl_replay_duration=123ns total_replay_duration=543.658µs 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.017Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.018Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-06T15:13:44.374 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.018Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.019Z caller=refresh.go:71 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.019Z caller=refresh.go:71 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.019Z caller=refresh.go:71 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.019Z caller=refresh.go:71 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.036Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.160118ms db_storage=848ns remote_storage=1.207µs web_handler=592ns query_engine=634ns scrape=266.874µs scrape_sd=141.658µs notify=974ns notify_sd=1.257µs rules=17.384763ms tracing=6.783µs 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.036Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-06T15:13:44.375 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[50528]: ts=2024-09-06T15:13:44.036Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-06T15:13:45.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[22757]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[22757]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[22757]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:45.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[22757]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:45.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[29727]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[29727]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[29727]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:45.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:44 smithi189 bash[29727]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:45.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[24979]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[24979]: audit 2024-09-06T15:13:43.768176+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14146 v1:172.21.15.189:0/3884847731' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T15:13:45.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[24979]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:45.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:44 smithi190 bash[24979]: cluster 2024-09-06T15:13:43.781897+0000 mon.a (mon.0) 764 : cluster [DBG] mgrmap e17: y(active, since 10m), standbys: x 2024-09-06T15:13:46.273 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:13:47.653 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.653+0000 7f58809d0640 1 -- 172.21.15.190:0/3381399789 >> v1:172.21.15.190:6789/0 conn(0x7f587c1058c0 legacy=0x7f587c107cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:47.653 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.653+0000 7f58809d0640 1 -- 172.21.15.190:0/3381399789 shutdown_connections 2024-09-06T15:13:47.653 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.653+0000 7f58809d0640 1 -- 172.21.15.190:0/3381399789 >> 172.21.15.190:0/3381399789 conn(0x7f587c0fcd10 msgr2=0x7f587c0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:47.653 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.653+0000 7f58809d0640 1 -- 172.21.15.190:0/3381399789 shutdown_connections 2024-09-06T15:13:47.653 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.653+0000 7f58809d0640 1 -- 172.21.15.190:0/3381399789 wait complete. 2024-09-06T15:13:47.654 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 Processor -- start 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- start start 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f587c1a1c20 con 0x7f587c101440 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f587c1a2e00 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f587c1a3fe0 con 0x7f587c109550 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f5879d9b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f587c1058c0 0x7f587c19cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:58546/0 (socket says 172.21.15.190:58546) 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f5879d9b640 1 -- 172.21.15.190:0/2179998877 learned_addr learned my addr 172.21.15.190:0/2179998877 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475574048 0 0) 0x7f587c1a2e00 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5864003520 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2531473175 0 0) 0x7f5864003520 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f587c1a2e00 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f58700014b0 con 0x7f587c1058c0 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307830423 0 0) 0x7f587c1a3fe0 con 0x7f587c109550 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5864003520 con 0x7f587c109550 2024-09-06T15:13:47.655 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069790542 0 0) 0x7f587c1a1c20 con 0x7f587c101440 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f587c1a3fe0 con 0x7f587c101440 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2639519438 0 0) 0x7f587c1a2e00 con 0x7f587c1058c0 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6790/0 conn(0x7f587c109550 legacy=0x7f587c1a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6789/0 conn(0x7f587c101440 legacy=0x7f587c196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1a51c0 con 0x7f587c1058c0 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f587c1a4210 con 0x7f587c1058c0 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f587c1a4840 con 0x7f587c1058c0 2024-09-06T15:13:47.656 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5870003800 con 0x7f587c1058c0 2024-09-06T15:13:47.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5870004c90 con 0x7f587c1058c0 2024-09-06T15:13:47.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.190:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f585c0050b0 con 0x7f587c1058c0 2024-09-06T15:13:47.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.657+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 7 ==== mgrmap(e 17) ==== 99851+0+0 (unknown 2560373587 0 0) 0x7f5870001900 con 0x7f587c1058c0 2024-09-06T15:13:47.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.661+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 8 ==== osd_map(66..66 src has 1..66) ==== 5857+0+0 (unknown 2856519743 0 0) 0x7f5870094f30 con 0x7f587c1058c0 2024-09-06T15:13:47.657 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.661+0000 7f587a59c640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5864078240 legacy=0x7f586407a700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/4002094494 2024-09-06T15:13:47.660 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.665+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f587005dea0 con 0x7f587c1058c0 2024-09-06T15:13:47.832 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.833+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.189:6800/4002094494 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}) -- 0x7f585c000bc0 con 0x7f5864078240 2024-09-06T15:13:47.861 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:47.865+0000 7f587a59c640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5864078240 legacy=0x7f586407a700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/4002094494 2024-09-06T15:13:48.265 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:48.269+0000 7f587a59c640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5864078240 legacy=0x7f586407a700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/4002094494 2024-09-06T15:13:49.070 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:49.073+0000 7f587a59c640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5864078240 legacy=0x7f586407a700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6800/4002094494 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: debug 2024-09-06T15:13:48.974+0000 7f90071e5040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: debug 2024-09-06T15:13:48.974+0000 7f90071e5040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: from .module import Module 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: from .fs.volume import VolumeClient 2024-09-06T15:13:49.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:13:49.349 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:13:49.349 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:13:49.349 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: debug 2024-09-06T15:13:48.974+0000 7f90071e5040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:13:49.349 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:48 smithi189 bash[23007]: debug 2024-09-06T15:13:48.974+0000 7f90071e5040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:13:49.372 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: debug 2024-09-06T15:13:49.001+0000 7f3e7f6b3040 -1 mgr[py] Module not found: 'volumes' 2024-09-06T15:13:49.372 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: debug 2024-09-06T15:13:49.001+0000 7f3e7f6b3040 -1 mgr[py] Traceback (most recent call last): 2024-09-06T15:13:49.372 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/__init__.py", line 2, in 2024-09-06T15:13:49.372 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: from .module import Module 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/module.py", line 9, in 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: from .fs.volume import VolumeClient 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: File "/usr/share/ceph/mgr/volumes/fs/volume.py", line 12, in 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: from ceph.fs.earmarking import CephFSVolumeEarmarking, EarmarkException # type: ignore 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: ModuleNotFoundError: No module named 'ceph.fs' 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: debug 2024-09-06T15:13:49.001+0000 7f3e7f6b3040 -1 mgr[py] Class not found in module 'volumes' 2024-09-06T15:13:49.373 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: debug 2024-09-06T15:13:49.001+0000 7f3e7f6b3040 -1 mgr[py] Error loading module 'volumes': (2) No such file or directory 2024-09-06T15:13:49.770 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:49.773+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 10 ==== mgrmap(e 18) ==== 99553+0+0 (unknown 2787087181 0 0) 0x7f5870059980 con 0x7f587c1058c0 2024-09-06T15:13:49.771 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:49.773+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/4002094494 conn(0x7f5864078240 legacy=0x7f586407a700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-06T15:13:50.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[23007]: debug 2024-09-06T15:13:49.734+0000 7f90071e5040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:50.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[29727]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.105 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.106 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:49 smithi189 bash[22757]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: debug 2024-09-06T15:13:49.761+0000 7f3e7f6b3040 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: [06/Sep/2024:15:13:49] ENGINE Bus STARTING 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: CherryPy Checker: 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: The Application mounted at '' has an empty config. 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: [06/Sep/2024:15:13:49] ENGINE Serving on http://:::9283 2024-09-06T15:13:50.122 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[25843]: [06/Sep/2024:15:13:49] ENGINE Bus STARTED 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.760348+0000 mon.a (mon.0) 765 : cluster [INF] Active manager daemon y restarted 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.760743+0000 mon.a (mon.0) 766 : cluster [INF] Activating manager daemon y 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.773504+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.774158+0000 mon.a (mon.0) 768 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0135573s), standbys: x 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780586+0000 mon.c (mon.2) 22 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780760+0000 mon.c (mon.2) 23 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.780913+0000 mon.c (mon.2) 24 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.782543+0000 mon.c (mon.2) 25 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.782788+0000 mon.c (mon.2) 26 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783072+0000 mon.c (mon.2) 27 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783359+0000 mon.c (mon.2) 28 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T15:13:50.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783620+0000 mon.c (mon.2) 29 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.783947+0000 mon.c (mon.2) 30 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784256+0000 mon.c (mon.2) 31 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784571+0000 mon.c (mon.2) 32 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.784834+0000 mon.c (mon.2) 33 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785099+0000 mon.c (mon.2) 34 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785457+0000 mon.c (mon.2) 35 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mds metadata"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.785677+0000 mon.a (mon.0) 769 : cluster [DBG] Standby manager daemon x restarted 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.785704+0000 mon.c (mon.2) 36 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd metadata"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.785800+0000 mon.a (mon.0) 770 : cluster [DBG] Standby manager daemon x started 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.786388+0000 mon.c (mon.2) 37 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "mon metadata"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.790504+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/crt"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.791233+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-06T15:13:50.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.792964+0000 mon.b (mon.1) 32 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/x/key"} : dispatch 2024-09-06T15:13:50.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:49 smithi190 bash[24979]: audit 2024-09-06T15:13:49.793652+0000 mon.b (mon.1) 33 : audit [DBG] from='mgr.? v1:172.21.15.190:0/861397706' entity='mgr.x' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-06T15:13:50.776 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.777+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mon.1 v1:172.21.15.190:6789/0 11 ==== mgrmap(e 19) ==== 99645+0+0 (unknown 3554713154 0 0) 0x7f5870068970 con 0x7f587c1058c0 2024-09-06T15:13:50.777 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.781+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 --> v1:172.21.15.189:6800/1420554776 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi190=a", "target": ["mon-mgr", ""]}) -- 0x7f586402f890 con 0x7f5864082300 2024-09-06T15:13:50.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.789+0000 7f586b7fe640 1 -- 172.21.15.190:0/2179998877 <== mgr.14631 v1:172.21.15.189:6800/1420554776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (unknown 0 0 664801700) 0x7f586402f890 con 0x7f5864082300 2024-09-06T15:13:50.788 INFO:teuthology.orchestra.run.smithi190.stdout:Scheduled grafana update... 2024-09-06T15:13:50.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.189:6800/1420554776 conn(0x7f5864082300 legacy=0x7f58640846f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:50.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 >> v1:172.21.15.190:6789/0 conn(0x7f587c1058c0 legacy=0x7f587c19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:50.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f587ad9d640 1 -- 172.21.15.190:0/2179998877 reap_dead start 2024-09-06T15:13:50.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 shutdown_connections 2024-09-06T15:13:50.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 >> 172.21.15.190:0/2179998877 conn(0x7f587c0fcd10 msgr2=0x7f587c10ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:50.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 shutdown_connections 2024-09-06T15:13:50.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:13:50.793+0000 7f58809d0640 1 -- 172.21.15.190:0/2179998877 wait complete. 2024-09-06T15:13:51.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[23007]: [06/Sep/2024:15:13:50] ENGINE Bus STARTING 2024-09-06T15:13:51.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[23007]: CherryPy Checker: 2024-09-06T15:13:51.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[23007]: The Application mounted at '' has an empty config. 2024-09-06T15:13:51.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[23007]: [06/Sep/2024:15:13:50] ENGINE Serving on http://:::9283 2024-09-06T15:13:51.098 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[23007]: [06/Sep/2024:15:13:50] ENGINE Bus STARTED 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[22757]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:50 smithi189 bash[29727]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.122 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:13:51.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.766108+0000 mgr.x (mgr.24523) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:13:51.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:49.824163+0000 mon.a (mon.0) 771 : cluster [INF] Manager daemon y is now available 2024-09-06T15:13:51.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.095425+0000 mon.c (mon.2) 38 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.121823+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.127658+0000 mon.c (mon.2) 39 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.132994+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.137905+0000 mon.c (mon.2) 40 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.138339+0000 mon.c (mon.2) 41 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.138343+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.157861+0000 mon.c (mon.2) 42 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.158324+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"} : dispatch 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: cluster 2024-09-06T15:13:50.777547+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e19: y(active, since 1.01694s), standbys: x 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:50 smithi190 bash[24979]: audit 2024-09-06T15:13:50.793940+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.614 DEBUG:teuthology.orchestra.run.smithi190:grafana.a> sudo journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@grafana.a.service 2024-09-06T15:13:51.617 INFO:tasks.cephadm:Setting up client nodes... 2024-09-06T15:13:51.617 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-06T15:13:51.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:51.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:51.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:51.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:51 smithi190 bash[24979]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[22757]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: cephadm 2024-09-06T15:13:50.788478+0000 mgr.y (mgr.14631) 6 : cephadm [INF] Saving service grafana spec with placement smithi190=a;count:1 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: audit 2024-09-06T15:13:50.868085+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[29727]: audit 2024-09-06T15:13:50.876578+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:52.099 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: debug 2024-09-06T15:13:51.682+0000 7f8f688a1640 -1 log_channel(cephadm) log [ERR] : [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: Traceback (most recent call last): 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: self._run(expiration_interval) 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:52.100 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: s = self.context.wrap_socket( 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: return self.sslsocket_class._create( 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: self.do_handshake() 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: self._sslobj.do_handshake() 2024-09-06T15:13:52.101 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:13:51 smithi189 bash[23007]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: Traceback (most recent call last): 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._run(expiration_interval) 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: Traceback (most recent call last): 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._run(expiration_interval) 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: s = self.context.wrap_socket( 2024-09-06T15:13:53.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: return self.sslsocket_class._create( 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self.do_handshake() 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._sslobj.do_handshake() 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: Traceback (most recent call last): 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._run(expiration_interval) 2024-09-06T15:13:53.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: s = self.context.wrap_socket( 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: return self.sslsocket_class._create( 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self.do_handshake() 2024-09-06T15:13:53.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: self._sslobj.do_handshake() 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[29727]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.107 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: s = self.context.wrap_socket( 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: return self.sslsocket_class._create( 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self.do_handshake() 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: self._sslobj.do_handshake() 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:53.108 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:52 smithi189 bash[22757]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:53.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.461858+0000 mgr.y (mgr.14631) 7 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTING 2024-09-06T15:13:53.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.123 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.563496+0000 mgr.y (mgr.14631) 8 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on http://172.21.15.189:8765 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.683230+0000 mgr.y (mgr.14631) 9 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Serving on https://172.21.15.189:7150 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.683448+0000 mgr.y (mgr.14631) 10 : cephadm [INF] [06/Sep/2024:15:13:51] ENGINE Bus STARTED 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: Traceback (most recent call last): 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._run(expiration_interval) 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: s = self.context.wrap_socket( 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: return self.sslsocket_class._create( 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self.do_handshake() 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._sslobj.do_handshake() 2024-09-06T15:13:53.125 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cephadm 2024-09-06T15:13:51.685141+0000 mgr.y (mgr.14631) 11 : cephadm [ERR] [06/Sep/2024:15:13:51] ENGINE Error in HTTPServer.serve 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: Traceback (most recent call last): 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._connections.run(self.expiration_interval) 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._run(expiration_interval) 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: s = self.context.wrap_socket( 2024-09-06T15:13:53.126 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: return self.sslsocket_class._create( 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self.do_handshake() 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: self._sslobj.do_handshake() 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cluster 2024-09-06T15:13:51.784258+0000 mgr.y (mgr.14631) 12 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:53.127 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:52 smithi190 bash[24979]: cluster 2024-09-06T15:13:52.800812+0000 mon.a (mon.0) 780 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-06T15:13:55.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[22757]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[22757]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[22757]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[22757]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[29727]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[29727]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[29727]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:54 smithi189 bash[29727]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:54 smithi190 bash[24979]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:54 smithi190 bash[24979]: cluster 2024-09-06T15:13:53.784936+0000 mgr.y (mgr.14631) 13 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail 2024-09-06T15:13:55.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:54 smithi190 bash[24979]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:54 smithi190 bash[24979]: cluster 2024-09-06T15:13:53.845268+0000 mon.a (mon.0) 781 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-06T15:13:55.903 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:13:56.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:55 smithi189 bash[29727]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:56.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:55 smithi189 bash[29727]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:56.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:55 smithi189 bash[22757]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:56.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:55 smithi189 bash[22757]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:56.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:55 smithi190 bash[24979]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:56.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:55 smithi190 bash[24979]: cluster 2024-09-06T15:13:55.786446+0000 mgr.y (mgr.14631) 14 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.198+0000 7f1fc27b3640 1 -- 172.21.15.189:0/1364706532 >> v1:172.21.15.189:6789/0 conn(0x7f1fbc10a670 legacy=0x7f1fbc10cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.198+0000 7f1fc27b3640 1 -- 172.21.15.189:0/1364706532 shutdown_connections 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.198+0000 7f1fc27b3640 1 -- 172.21.15.189:0/1364706532 >> 172.21.15.189:0/1364706532 conn(0x7f1fbc0fcd30 msgr2=0x7f1fbc0ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.198+0000 7f1fc27b3640 1 -- 172.21.15.189:0/1364706532 shutdown_connections 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.198+0000 7f1fc27b3640 1 -- 172.21.15.189:0/1364706532 wait complete. 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fc27b3640 1 Processor -- start 2024-09-06T15:13:57.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fc27b3640 1 -- start start 2024-09-06T15:13:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fc27b3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1fbc1a2d00 con 0x7f1fbc06b430 2024-09-06T15:13:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fc27b3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1fbc1a3ee0 con 0x7f1fbc1068f0 2024-09-06T15:13:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fc27b3640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1fbc1a50c0 con 0x7f1fbc10a670 2024-09-06T15:13:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fbbfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1fbc06b430 0x7f1fbc197c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:52488/0 (socket says 172.21.15.189:52488) 2024-09-06T15:13:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fbbfff640 1 -- 172.21.15.189:0/2864056854 learned_addr learned my addr 172.21.15.189:0/2864056854 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:13:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613290888 0 0) 0x7f1fbc1a2d00 con 0x7f1fbc06b430 2024-09-06T15:13:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa4003520 con 0x7f1fbc06b430 2024-09-06T15:13:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.202+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828128133 0 0) 0x7f1fbc1a3ee0 con 0x7f1fbc1068f0 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fbc1a2d00 con 0x7f1fbc1068f0 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3004070409 0 0) 0x7f1fa4003520 con 0x7f1fbc06b430 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fbc1a3ee0 con 0x7f1fbc06b430 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1fac001970 con 0x7f1fbc06b430 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 429315335 0 0) 0x7f1fbc1a2d00 con 0x7f1fbc1068f0 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fa4003520 con 0x7f1fbc1068f0 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1fb00018a0 con 0x7f1fbc1068f0 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 185946310 0 0) 0x7f1fbc1a3ee0 con 0x7f1fbc06b430 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 >> v1:172.21.15.189:6790/0 conn(0x7f1fbc10a670 legacy=0x7f1fbc1a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 >> v1:172.21.15.190:6789/0 conn(0x7f1fbc1068f0 legacy=0x7f1fbc19deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1a62a0 con 0x7f1fbc06b430 2024-09-06T15:13:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1a52f0 con 0x7f1fbc06b430 2024-09-06T15:13:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1fbc1a5920 con 0x7f1fbc06b430 2024-09-06T15:13:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1fac003a80 con 0x7f1fbc06b430 2024-09-06T15:13:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1fac005b80 con 0x7f1fbc06b430 2024-09-06T15:13:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa80050b0 con 0x7f1fbc06b430 2024-09-06T15:13:57.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f1fac005da0 con 0x7f1fbc06b430 2024-09-06T15:13:57.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.206+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f1fac094f50 con 0x7f1fbc06b430 2024-09-06T15:13:57.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.210+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f1fac05ded0 con 0x7f1fbc06b430 2024-09-06T15:13:57.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[29727]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:57 smithi189 bash[22757]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.005896+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.011932+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.259891+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:57 smithi190 bash[24979]: audit 2024-09-06T15:13:56.265602+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:57.432 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.438+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1fa80053a0 con 0x7f1fbc06b430 2024-09-06T15:13:57.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fb97fa640 1 -- 172.21.15.189:0/2864056854 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (unknown 57899324 0 1070230871) 0x7f1fac062040 con 0x7f1fbc06b430 2024-09-06T15:13:57.436 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-09-06T15:13:57.436 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQA1HNtmzbMuGhAAy+atxMHOyo0NiSwc3DHMwg== 2024-09-06T15:13:57.438 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 >> v1:172.21.15.189:6800/1420554776 conn(0x7f1fa40782f0 legacy=0x7f1fa407a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:57.438 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 >> v1:172.21.15.189:6789/0 conn(0x7f1fbc06b430 legacy=0x7f1fbc197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:13:57.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 shutdown_connections 2024-09-06T15:13:57.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 >> 172.21.15.189:0/2864056854 conn(0x7f1fbc0fcd30 msgr2=0x7f1fbc10caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:13:57.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 shutdown_connections 2024-09-06T15:13:57.439 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:13:57.442+0000 7f1fc27b3640 1 -- 172.21.15.189:0/2864056854 wait complete. 2024-09-06T15:13:58.124 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-06T15:13:58.124 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-06T15:13:58.124 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-06T15:13:58.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.534 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.535 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.536 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.540 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.543 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[29727]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.547 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.548 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.549 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:58 smithi189 bash[22757]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.180790+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.190744+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.194973+0000 mon.c (mon.2) 43 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.195311+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.196125+0000 mon.c (mon.2) 44 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.196395+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.197107+0000 mon.c (mon.2) 45 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.197370+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.624 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.198240+0000 mon.c (mon.2) 46 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.198490+0000 mon.a (mon.0) 791 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.199169+0000 mgr.y (mgr.14631) 15 : cephadm [INF] Adjusting osd_memory_target on smithi190 to 3804M 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.205271+0000 mon.a (mon.0) 792 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.389503+0000 mon.a (mon.0) 793 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.399764+0000 mon.a (mon.0) 794 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.403520+0000 mon.c (mon.2) 47 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.625 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404006+0000 mon.a (mon.0) 795 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404774+0000 mon.c (mon.2) 48 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.404982+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.626 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.405659+0000 mon.c (mon.2) 49 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.405861+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.406535+0000 mon.c (mon.2) 50 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.406762+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.14631 ' entity='mgr.y' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.407328+0000 mgr.y (mgr.14631) 16 : cephadm [INF] Adjusting osd_memory_target on smithi189 to 3804M 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.627 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.412845+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.417509+0000 mon.c (mon.2) 51 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.418159+0000 mon.c (mon.2) 52 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.419208+0000 mgr.y (mgr.14631) 17 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.conf 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.419392+0000 mgr.y (mgr.14631) 18 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.conf 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.439054+0000 mon.a (mon.0) 800 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.442982+0000 mon.a (mon.0) 801 : audit [INF] from='client.? v1:172.21.15.189:0/2864056854' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:13:58.628 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.546849+0000 mgr.y (mgr.14631) 19 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.574282+0000 mgr.y (mgr.14631) 20 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.658274+0000 mgr.y (mgr.14631) 21 : cephadm [INF] Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.714566+0000 mgr.y (mgr.14631) 22 : cephadm [INF] Updating smithi190:/etc/ceph/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.778218+0000 mgr.y (mgr.14631) 23 : cephadm [INF] Updating smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: cluster 2024-09-06T15:13:57.787060+0000 mgr.y (mgr.14631) 24 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.916103+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.629 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.924388+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:57.990061+0000 mon.a (mon.0) 804 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:58.002082+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.630 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:58 smithi190 bash[24979]: audit 2024-09-06T15:13:58.011471+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:13:58.848 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:13:58 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:13:59.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[22757]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[22757]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[22757]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[29727]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[29727]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:13:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:13:59 smithi189 bash[29727]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:13:59.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:59 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:59 smithi190 bash[24979]: cephadm 2024-09-06T15:13:57.861934+0000 mgr.y (mgr.14631) 25 : cephadm [INF] Updating smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T15:13:59.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:59 smithi190 bash[24979]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:13:59.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:13:59 smithi190 bash[24979]: cephadm 2024-09-06T15:13:58.039484+0000 mgr.y (mgr.14631) 26 : cephadm [INF] Deploying daemon alertmanager.a on smithi189 2024-09-06T15:14:00.786 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:00 smithi190 bash[24979]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:00.786 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:00 smithi190 bash[24979]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:00.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:00 smithi189 bash[29727]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:00.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:00 smithi189 bash[29727]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:00.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:00 smithi189 bash[22757]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:00.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:00 smithi189 bash[22757]: cluster 2024-09-06T15:13:59.787914+0000 mgr.y (mgr.14631) 27 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T15:14:01.122 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:00 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:01.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:01 smithi189 bash[22757]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:01.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:01 smithi189 bash[22757]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:01.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:01 smithi189 bash[29727]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:01.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:01 smithi189 bash[29727]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:01.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:01 smithi190 bash[24979]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:01.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:01 smithi190 bash[24979]: audit 2024-09-06T15:14:00.791909+0000 mgr.y (mgr.14631) 28 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:02 smithi189 bash[22757]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:02 smithi189 bash[22757]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:02 smithi189 bash[29727]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:02 smithi189 bash[29727]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:02 smithi190 bash[24979]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:02 smithi190 bash[24979]: cluster 2024-09-06T15:14:01.789762+0000 mgr.y (mgr.14631) 29 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:02.949 INFO:teuthology.orchestra.run.smithi190.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.b/config 2024-09-06T15:14:04.177 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- 172.21.15.190:0/2041779834 >> v1:172.21.15.190:6789/0 conn(0x7f642810b5f0 legacy=0x7f642810d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- 172.21.15.190:0/2041779834 shutdown_connections 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- 172.21.15.190:0/2041779834 >> 172.21.15.190:0/2041779834 conn(0x7f64280fd280 msgr2=0x7f64280ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- 172.21.15.190:0/2041779834 shutdown_connections 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- 172.21.15.190:0/2041779834 wait complete. 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 Processor -- start 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- start start 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f642810eaf0 con 0x7f64281037e0 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f64281aab00 con 0x7f642810f100 2024-09-06T15:14:04.178 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642cf8a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f64281abce0 con 0x7f642810b5f0 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642659c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f64281037e0 0x7f642810df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.190:32944/0 (socket says 172.21.15.190:32944) 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.177+0000 7f642659c640 1 -- 172.21.15.190:0/4266645486 learned_addr learned my addr 172.21.15.190:0/4266645486 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610996228 0 0) 0x7f64281aab00 con 0x7f642810f100 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6410003520 con 0x7f642810f100 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90179753 0 0) 0x7f642810eaf0 con 0x7f64281037e0 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64281aab00 con 0x7f64281037e0 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078550968 0 0) 0x7f64281abce0 con 0x7f642810b5f0 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642810eaf0 con 0x7f642810b5f0 2024-09-06T15:14:04.179 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1761260286 0 0) 0x7f64281aab00 con 0x7f64281037e0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64281abce0 con 0x7f64281037e0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776250640 0 0) 0x7f6410003520 con 0x7f642810f100 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64281aab00 con 0x7f642810f100 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6418001970 con 0x7f64281037e0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4062815233 0 0) 0x7f642810eaf0 con 0x7f642810b5f0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6410003520 con 0x7f642810b5f0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6420001bb0 con 0x7f642810f100 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f641c004570 con 0x7f642810b5f0 2024-09-06T15:14:04.180 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3767497165 0 0) 0x7f64281abce0 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 >> v1:172.21.15.189:6790/0 conn(0x7f642810b5f0 legacy=0x7f64281a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 >> v1:172.21.15.190:6789/0 conn(0x7f642810f100 legacy=0x7f64281a83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64281acf10 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64281abf10 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f64281ac540 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f6418001cb0 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6418005c50 con 0x7f64281037e0 2024-09-06T15:14:04.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64080050b0 con 0x7f64281037e0 2024-09-06T15:14:04.182 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f64180038c0 con 0x7f64281037e0 2024-09-06T15:14:04.182 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.181+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f6418094bd0 con 0x7f64281037e0 2024-09-06T15:14:04.183 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.185+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f641805db50 con 0x7f64281037e0 2024-09-06T15:14:04.212 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:03 smithi189 bash[22757]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.213 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:03 smithi189 bash[22757]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.213 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:03 smithi189 bash[29727]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.213 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:03 smithi189 bash[29727]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:03 smithi190 bash[24979]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:03 smithi190 bash[24979]: cluster 2024-09-06T15:14:03.790729+0000 mgr.y (mgr.14631) 30 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-06T15:14:04.401 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.405+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f64080053a0 con 0x7f64281037e0 2024-09-06T15:14:04.405 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f64177fe640 1 -- 172.21.15.190:0/4266645486 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (unknown 3508017507 0 3169267800) 0x7f6418061cc0 con 0x7f64281037e0 2024-09-06T15:14:04.405 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2024-09-06T15:14:04.405 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA8HNtmJkxZGBAAf3AByw4WybnBDhQUNykHRQ== 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 >> v1:172.21.15.189:6800/1420554776 conn(0x7f6410078510 legacy=0x7f641007a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 >> v1:172.21.15.189:6789/0 conn(0x7f64281037e0 legacy=0x7f642810df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 shutdown_connections 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 >> 172.21.15.190:0/4266645486 conn(0x7f64280fd280 msgr2=0x7f64281114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 shutdown_connections 2024-09-06T15:14:04.407 INFO:teuthology.orchestra.run.smithi190.stderr:2024-09-06T15:14:04.409+0000 7f642cf8a640 1 -- 172.21.15.190:0/4266645486 wait complete. 2024-09-06T15:14:05.093 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-09-06T15:14:05.093 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-06T15:14:05.093 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-06T15:14:05.117 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph config log 1 --format=json 2024-09-06T15:14:05.220 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[29727]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.220 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[29727]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.220 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[29727]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:05.220 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[29727]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:05.220 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[22757]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.221 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[22757]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.221 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[22757]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:05.221 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:04 smithi189 bash[22757]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:05.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:04 smithi190 bash[24979]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:04 smithi190 bash[24979]: audit 2024-09-06T15:14:04.408163+0000 mon.a (mon.0) 807 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-06T15:14:05.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:04 smithi190 bash[24979]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:05.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:04 smithi190 bash[24979]: audit 2024-09-06T15:14:04.411427+0000 mon.a (mon.0) 808 : audit [INF] from='client.? v1:172.21.15.190:0/4266645486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T15:14:06.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[29727]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[29727]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[29727]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.155 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[29727]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.155 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[22757]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.155 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[22757]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.155 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[22757]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.155 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:05 smithi189 bash[22757]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:05 smithi190 bash[24979]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:05 smithi190 bash[24979]: audit 2024-09-06T15:14:05.169688+0000 mon.c (mon.2) 53 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:06.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:05 smithi190 bash[24979]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:05 smithi190 bash[24979]: cluster 2024-09-06T15:14:05.792165+0000 mgr.y (mgr.14631) 31 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-06T15:14:06.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.967 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.967 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.967 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.968 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.968 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:06.968 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.223 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.223 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.224 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.224 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.224 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.224 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.225 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.225 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.225 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.225 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:06 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.226 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:07.226 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:07 smithi189 systemd[1]: Started Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:08.401 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.401 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.401 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.402 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.402 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.402 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.402 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.403 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[22757]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.404 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[29727]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.405 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.276755+0000 mon.a (mon.0) 809 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.282417+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.287517+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: audit 2024-09-06T15:14:07.291857+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: cephadm 2024-09-06T15:14:07.294783+0000 mgr.y (mgr.14631) 32 : cephadm [INF] Deploying daemon node-exporter.a on smithi189 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:08 smithi190 bash[24979]: cluster 2024-09-06T15:14:07.792711+0000 mgr.y (mgr.14631) 33 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:08.651 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.651 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.652 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.652 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.652 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.653 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.653 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.653 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:08.653 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.098 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:08 smithi189 systemd[1]: Started Ceph node-exporter.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:09.098 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58218]: Unable to find image 'quay.io/prometheus/node-exporter:v1.7.0' locally 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.723Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.723Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.725Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.189 port=9094 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.726Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.758Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.758Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.760Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-06T15:14:09.099 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:08 smithi189 bash[58052]: ts=2024-09-06T15:14:08.760Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-06T15:14:09.597 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: v1.7.0: Pulling from prometheus/node-exporter 2024-09-06T15:14:09.754 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.754 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.755 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.755 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.755 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.756 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.756 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.756 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.757 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.757 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.757 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[24979]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.966 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[22757]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.702512+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.707786+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: audit 2024-09-06T15:14:08.713506+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.967 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[29727]: cephadm 2024-09-06T15:14:08.714569+0000 mgr.y (mgr.14631) 34 : cephadm [INF] Deploying daemon node-exporter.b on smithi190 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 2abcce694348: Pulling fs layer 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 455fd88e5221: Pulling fs layer 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 324153f2810a: Pulling fs layer 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 2abcce694348: Download complete 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 455fd88e5221: Verifying Checksum 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 455fd88e5221: Download complete 2024-09-06T15:14:09.968 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 324153f2810a: Verifying Checksum 2024-09-06T15:14:10.124 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.125 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.125 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.125 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.126 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.126 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.126 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.127 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:10.127 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:09 smithi190 systemd[1]: Started Ceph node-exporter.b for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:10.127 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:09 smithi190 bash[51347]: Unable to find image 'quay.io/prometheus/node-exporter:v1.7.0' locally 2024-09-06T15:14:10.347 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:09 smithi189 bash[58218]: 324153f2810a: Download complete 2024-09-06T15:14:10.347 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[58218]: 2abcce694348: Pull complete 2024-09-06T15:14:10.768 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[58052]: ts=2024-09-06T15:14:10.727Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000769152s 2024-09-06T15:14:10.769 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[58218]: 455fd88e5221: Pull complete 2024-09-06T15:14:10.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.769 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[22757]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.770 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.771 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[29727]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.794 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: v1.7.0: Pulling from prometheus/node-exporter 2024-09-06T15:14:10.794 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 2abcce694348: Pulling fs layer 2024-09-06T15:14:10.794 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 455fd88e5221: Pulling fs layer 2024-09-06T15:14:10.794 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 324153f2810a: Pulling fs layer 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: cluster 2024-09-06T15:14:09.793190+0000 mgr.y (mgr.14631) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.918476+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.794 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.929161+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.936247+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.945988+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:09.973931+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.795 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[24979]: audit 2024-09-06T15:14:10.126349+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:10.899 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:11.042 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[58218]: 324153f2810a: Pull complete 2024-09-06T15:14:11.042 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[23007]: [06/Sep/2024:15:14:10] ENGINE Bus STOPPING 2024-09-06T15:14:11.042 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[23007]: [06/Sep/2024:15:14:10] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-06T15:14:11.042 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[23007]: [06/Sep/2024:15:14:10] ENGINE Bus STOPPED 2024-09-06T15:14:11.042 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:10 smithi189 bash[23007]: [06/Sep/2024:15:14:10] ENGINE Bus STARTING 2024-09-06T15:14:11.042 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[23007]: [06/Sep/2024:15:14:11] ENGINE Serving on http://:::9283 2024-09-06T15:14:11.055 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:11.055 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 455fd88e5221: Verifying Checksum 2024-09-06T15:14:11.055 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 455fd88e5221: Download complete 2024-09-06T15:14:11.055 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 2abcce694348: Verifying Checksum 2024-09-06T15:14:11.055 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:10 smithi190 bash[51347]: 2abcce694348: Download complete 2024-09-06T15:14:11.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[23007]: [06/Sep/2024:15:14:11] ENGINE Bus STARTED 2024-09-06T15:14:11.371 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[51347]: 2abcce694348: Pull complete 2024-09-06T15:14:11.744 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[51347]: 324153f2810a: Verifying Checksum 2024-09-06T15:14:11.744 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[51347]: 324153f2810a: Download complete 2024-09-06T15:14:11.744 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[51347]: 455fd88e5221: Pull complete 2024-09-06T15:14:11.745 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[58218]: Digest: sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80 2024-09-06T15:14:11.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:11 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:12.097 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[58218]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.7.0 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[22757]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:11 smithi189 bash[29727]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.101 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: cephadm 2024-09-06T15:14:09.977246+0000 mgr.y (mgr.14631) 36 : cephadm [INF] Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.750220+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.756793+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.760555+0000 mon.c (mon.2) 54 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"} : dispatch 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.761154+0000 mgr.y (mgr.14631) 37 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.767719+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.799587+0000 mgr.y (mgr.14631) 38 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:12.103 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.103 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: cephadm 2024-09-06T15:14:10.800287+0000 mgr.y (mgr.14631) 39 : cephadm [INF] Deploying daemon grafana.a on smithi190 2024-09-06T15:14:12.103 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.103 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:11 smithi190 bash[24979]: audit 2024-09-06T15:14:10.916705+0000 mon.c (mon.2) 55 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:14:12.372 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[51347]: 324153f2810a: Pull complete 2024-09-06T15:14:12.372 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[51347]: Digest: sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80 2024-09-06T15:14:12.752 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[51347]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.7.0 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[29727]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[29727]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[29727]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[29727]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[22757]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[22757]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[22757]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:12 smithi189 bash[22757]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[24979]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[24979]: audit 2024-09-06T15:14:10.917486+0000 mgr.y (mgr.14631) 40 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:14:13.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[24979]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:12 smithi190 bash[24979]: cluster 2024-09-06T15:14:11.794610+0000 mgr.y (mgr.14631) 41 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2524171488 >> v1:172.21.15.189:6789/0 conn(0x7f860410efd0 legacy=0x7f8604111490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2524171488 shutdown_connections 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2524171488 >> 172.21.15.189:0/2524171488 conn(0x7f86040fe2f0 msgr2=0x7f8604100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2524171488 shutdown_connections 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2524171488 wait complete. 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 Processor -- start 2024-09-06T15:14:13.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- start start 2024-09-06T15:14:13.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86041a96f0 con 0x7f860410efd0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86041aa8f0 con 0x7f860410b430 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86041abaf0 con 0x7f86041028c0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f860259c640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f86041028c0 0x7f86040769f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:53682/0 (socket says 172.21.15.189:53682) 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f860259c640 1 -- 172.21.15.189:0/2001722157 learned_addr learned my addr 172.21.15.189:0/2001722157 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654501986 0 0) 0x7f86041abaf0 con 0x7f86041028c0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ec003520 con 0x7f86041028c0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078241286 0 0) 0x7f86041a96f0 con 0x7f860410efd0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86041abaf0 con 0x7f860410efd0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3091512577 0 0) 0x7f85ec003520 con 0x7f86041028c0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86041a96f0 con 0x7f86041028c0 2024-09-06T15:14:13.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f85f4001a30 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151085970 0 0) 0x7f86041aa8f0 con 0x7f860410b430 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85ec003520 con 0x7f860410b430 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3820792404 0 0) 0x7f86041abaf0 con 0x7f860410efd0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86041aa8f0 con 0x7f860410efd0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f85fc001830 con 0x7f860410efd0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3293056441 0 0) 0x7f86041a96f0 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 >> v1:172.21.15.190:6789/0 conn(0x7f860410b430 legacy=0x7f86041a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 >> v1:172.21.15.189:6789/0 conn(0x7f860410efd0 legacy=0x7f86041a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86041acd90 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86041a9920 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f86041a9f50 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f85f4001cb0 con 0x7f86041028c0 2024-09-06T15:14:13.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f85f4005cf0 con 0x7f86041028c0 2024-09-06T15:14:13.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.482+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e40050b0 con 0x7f86041028c0 2024-09-06T15:14:13.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.486+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f85f40038c0 con 0x7f86041028c0 2024-09-06T15:14:13.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.486+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f85f4094e30 con 0x7f86041028c0 2024-09-06T15:14:13.484 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.490+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f85f405ddb0 con 0x7f86041028c0 2024-09-06T15:14:13.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.457Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-06T15:14:13.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.457Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-06T15:14:13.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.458Z caller=node_exporter.go:117 level=info collector=arp 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-06T15:14:13.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=edac 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-06T15:14:13.600 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=os 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-06T15:14:13.601 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=stat 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=time 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=uname 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-06T15:14:13.602 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[58218]: ts=2024-09-06T15:14:13.459Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-06T15:14:13.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.654+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f85e40053a0 con 0x7f86041028c0 2024-09-06T15:14:13.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.654+0000 7f85f37fe640 1 -- 172.21.15.189:0/2001722157 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v28) ==== 86+0+156 (unknown 4076466650 0 413065859) 0x7f85f4061f20 con 0x7f86041028c0 2024-09-06T15:14:13.650 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 >> v1:172.21.15.189:6800/1420554776 conn(0x7f85ec078410 legacy=0x7f85ec07a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 >> v1:172.21.15.189:6790/0 conn(0x7f86041028c0 legacy=0x7f86040769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 shutdown_connections 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 >> 172.21.15.189:0/2001722157 conn(0x7f86040fe2f0 msgr2=0x7f86041006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 shutdown_connections 2024-09-06T15:14:13.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:13.658+0000 7f8608cc5640 1 -- 172.21.15.189:0/2001722157 wait complete. 2024-09-06T15:14:14.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[29727]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[29727]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[22757]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:13 smithi189 bash[22757]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:13 smithi190 bash[24979]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:13 smithi190 bash[24979]: audit 2024-09-06T15:14:13.657112+0000 mon.c (mon.2) 56 : audit [DBG] from='client.? v1:172.21.15.189:0/2001722157' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-06T15:14:14.341 INFO:teuthology.orchestra.run.smithi189.stdout:[{"version":28,"timestamp":"2024-09-06T15:14:10.762038+0000","name":"","changes":[{"name":"mgr/mgr/dashboard/GRAFANA_API_SSL_VERIFY","new_value":"false"}]}] 2024-09-06T15:14:14.342 INFO:tasks.ceph_manager:config epoch is 28 2024-09-06T15:14:14.342 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-06T15:14:14.342 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-06T15:14:14.342 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph mgr dump --format=json 2024-09-06T15:14:15.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:14 smithi189 bash[22757]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:15.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:14 smithi189 bash[22757]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:15.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:14 smithi189 bash[29727]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:15.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:14 smithi189 bash[29727]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:15.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:14 smithi190 bash[24979]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:15.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:14 smithi190 bash[24979]: cluster 2024-09-06T15:14:13.795342+0000 mgr.y (mgr.14631) 42 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:16.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:15 smithi189 bash[22757]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:15 smithi189 bash[22757]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:15 smithi189 bash[29727]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:15 smithi189 bash[29727]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:15 smithi190 bash[24979]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:15 smithi190 bash[24979]: cluster 2024-09-06T15:14:15.796786+0000 mgr.y (mgr.14631) 43 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:16.372 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.032Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-09-06T15:14:16.372 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.032Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.033Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.033Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.033Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.033Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=arp 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-06T15:14:16.373 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=edac 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-06T15:14:16.374 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=os 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-06T15:14:16.375 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=stat 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=time 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=uname 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.034Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.035Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-09-06T15:14:16.376 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:16 smithi190 bash[51347]: ts=2024-09-06T15:14:16.035Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-06T15:14:18.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:17 smithi189 bash[22757]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:18.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:17 smithi189 bash[22757]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:17 smithi189 bash[29727]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:17 smithi189 bash[29727]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:18.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:17 smithi190 bash[24979]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:18.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:17 smithi190 bash[24979]: cluster 2024-09-06T15:14:17.797525+0000 mgr.y (mgr.14631) 44 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:19.097 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:18 smithi189 bash[58052]: ts=2024-09-06T15:14:18.730Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003495458s 2024-09-06T15:14:19.142 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:20.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:19 smithi189 bash[29727]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:19 smithi189 bash[29727]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.193 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:19 smithi189 bash[22757]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.194 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:19 smithi189 bash[22757]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.346 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- 172.21.15.189:0/11069120 >> v1:172.21.15.189:6790/0 conn(0x7f35301028d0 legacy=0x7f3530102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:20.346 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- 172.21.15.189:0/11069120 shutdown_connections 2024-09-06T15:14:20.346 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- 172.21.15.189:0/11069120 >> 172.21.15.189:0/11069120 conn(0x7f35300fe360 msgr2=0x7f3530100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:20.346 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- 172.21.15.189:0/11069120 shutdown_connections 2024-09-06T15:14:20.346 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- 172.21.15.189:0/11069120 wait complete. 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 Processor -- start 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- start start 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f35301a7560 con 0x7f353010b440 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f35301a8760 con 0x7f353010efe0 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f3535c3c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f35301a9960 con 0x7f35301028d0 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352f7fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f35301028d0 0x7f353010e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:38246/0 (socket says 172.21.15.189:38246) 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352f7fe640 1 -- 172.21.15.189:0/3162824323 learned_addr learned my addr 172.21.15.189:0/3162824323 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:20.347 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968552441 0 0) 0x7f35301a7560 con 0x7f353010b440 2024-09-06T15:14:20.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f351c003160 con 0x7f353010b440 2024-09-06T15:14:20.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655309759 0 0) 0x7f35301a9960 con 0x7f35301028d0 2024-09-06T15:14:20.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35301a7560 con 0x7f35301028d0 2024-09-06T15:14:20.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947422823 0 0) 0x7f35301a8760 con 0x7f353010efe0 2024-09-06T15:14:20.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.350+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35301a9960 con 0x7f353010efe0 2024-09-06T15:14:20.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 632080790 0 0) 0x7f351c003160 con 0x7f353010b440 2024-09-06T15:14:20.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35301a8760 con 0x7f353010b440 2024-09-06T15:14:20.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3780934434 0 0) 0x7f35301a7560 con 0x7f35301028d0 2024-09-06T15:14:20.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f351c003160 con 0x7f35301028d0 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f3520001280 con 0x7f353010b440 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f3518001a50 con 0x7f35301028d0 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4100124401 0 0) 0x7f35301a9960 con 0x7f353010efe0 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35301a7560 con 0x7f353010efe0 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f3528001c70 con 0x7f353010efe0 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1429255326 0 0) 0x7f35301a8760 con 0x7f353010b440 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 >> v1:172.21.15.189:6790/0 conn(0x7f35301028d0 legacy=0x7f353010e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 >> v1:172.21.15.190:6789/0 conn(0x7f353010efe0 legacy=0x7f35301a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35301aac00 con 0x7f353010b440 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35301a9b90 con 0x7f353010b440 2024-09-06T15:14:20.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f35301aa140 con 0x7f353010b440 2024-09-06T15:14:20.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f3520003a60 con 0x7f353010b440 2024-09-06T15:14:20.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f35200048c0 con 0x7f353010b440 2024-09-06T15:14:20.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35100050b0 con 0x7f353010b440 2024-09-06T15:14:20.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f35200042c0 con 0x7f353010b440 2024-09-06T15:14:20.351 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.354+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f3520093710 con 0x7f353010b440 2024-09-06T15:14:20.354 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.358+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f352005c690 con 0x7f353010b440 2024-09-06T15:14:20.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:19 smithi190 bash[24979]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:19 smithi190 bash[24979]: cluster 2024-09-06T15:14:19.798253+0000 mgr.y (mgr.14631) 45 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:20.565 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.570+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f35100053a0 con 0x7f353010b440 2024-09-06T15:14:20.570 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.574+0000 7f352cff9640 1 -- 172.21.15.189:0/3162824323 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+191823 (unknown 3290845145 0 3241070401) 0x7f3520060800 con 0x7f353010b440 2024-09-06T15:14:20.573 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 >> v1:172.21.15.189:6800/1420554776 conn(0x7f351c0784c0 legacy=0x7f351c07a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 >> v1:172.21.15.189:6789/0 conn(0x7f353010b440 legacy=0x7f35301a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 shutdown_connections 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 >> 172.21.15.189:0/3162824323 conn(0x7f35300fe360 msgr2=0x7f35301114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 shutdown_connections 2024-09-06T15:14:20.575 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:20.578+0000 7f3535c3c640 1 -- 172.21.15.189:0/3162824323 wait complete. 2024-09-06T15:14:21.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[24979]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.122 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:20 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:21.169 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[22757]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.213970+0000 mon.c (mon.2) 57 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.572350+0000 mon.a (mon.0) 825 : audit [DBG] from='client.? v1:172.21.15.189:0/3162824323' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-06T15:14:21.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:20 smithi189 bash[29727]: audit 2024-09-06T15:14:20.807608+0000 mgr.y (mgr.14631) 46 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:21.171 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":21,"flags":0,"active_gid":14631,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1420554776}]},"active_addr":"172.21.15.189:6800/1420554776","active_change":"2024-09-06T15:13:49.760587+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24523,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":false,"error_string":"No module named 'ceph.fs'","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.189:8443/","prometheus":"http://172.21.15.189:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":67,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":1732515256}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":114085575}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":2743674109}]}]} 2024-09-06T15:14:21.176 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-06T15:14:21.176 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-06T15:14:21.176 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T15:14:22.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:21 smithi189 bash[22757]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:22.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:21 smithi189 bash[22757]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:22.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:21 smithi189 bash[29727]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:22.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:21 smithi189 bash[29727]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:22.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:21 smithi190 bash[24979]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:22.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:21 smithi190 bash[24979]: cluster 2024-09-06T15:14:21.799770+0000 mgr.y (mgr.14631) 47 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:24.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:23 smithi189 bash[22757]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:24.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:23 smithi189 bash[22757]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:24.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:23 smithi189 bash[29727]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:24.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:23 smithi189 bash[29727]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:24.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:23 smithi190 bash[24979]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:24.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:23 smithi190 bash[24979]: cluster 2024-09-06T15:14:23.800499+0000 mgr.y (mgr.14631) 48 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:25.974 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:26.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:25 smithi190 bash[24979]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:26.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:25 smithi190 bash[24979]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:26.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:25 smithi189 bash[22757]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:26.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:25 smithi189 bash[22757]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:26.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:25 smithi189 bash[29727]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:26.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:25 smithi189 bash[29727]: cluster 2024-09-06T15:14:25.801938+0000 mgr.y (mgr.14631) 49 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:27.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/730492226 >> v1:172.21.15.189:6789/0 conn(0x7f13e41111e0 legacy=0x7f13e41136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:27.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/730492226 shutdown_connections 2024-09-06T15:14:27.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/730492226 >> 172.21.15.189:0/730492226 conn(0x7f13e4100520 msgr2=0x7f13e4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:27.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/730492226 shutdown_connections 2024-09-06T15:14:27.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/730492226 wait complete. 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 Processor -- start 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- start start 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13e41a9760 con 0x7f13e41111e0 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13e41aa960 con 0x7f13e4104ad0 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f13e41abb60 con 0x7f13e410d640 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e37fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f13e410d640 0x7f13e41a4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:38260/0 (socket says 172.21.15.189:38260) 2024-09-06T15:14:27.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e37fe640 1 -- 172.21.15.189:0/2120101365 learned_addr learned my addr 172.21.15.189:0/2120101365 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e88ea640 1 --1- 172.21.15.189:0/2120101365 >> v1:172.21.15.189:6789/0 conn(0x7f13e41111e0 0x7f13e41a7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:42588/0 (socket says 172.21.15.189:42588) 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960807953 0 0) 0x7f13e41abb60 con 0x7f13e410d640 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d0003520 con 0x7f13e410d640 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642075301 0 0) 0x7f13e41a9760 con 0x7f13e41111e0 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e41abb60 con 0x7f13e41111e0 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 363377381 0 0) 0x7f13d0003520 con 0x7f13e410d640 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e41a9760 con 0x7f13e410d640 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f13cc001a30 con 0x7f13e410d640 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3710431096 0 0) 0x7f13e41abb60 con 0x7f13e41111e0 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d0003520 con 0x7f13e41111e0 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f13dc001430 con 0x7f13e41111e0 2024-09-06T15:14:27.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379473415 0 0) 0x7f13e41aa960 con 0x7f13e4104ad0 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e41abb60 con 0x7f13e4104ad0 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2458973713 0 0) 0x7f13e41a9760 con 0x7f13e410d640 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 >> v1:172.21.15.190:6789/0 conn(0x7f13e4104ad0 legacy=0x7f13e41108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 >> v1:172.21.15.189:6789/0 conn(0x7f13e41111e0 legacy=0x7f13e41a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41ace00 con 0x7f13e410d640 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41a9990 con 0x7f13e410d640 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13e41a9f70 con 0x7f13e410d640 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f13cc001d30 con 0x7f13e410d640 2024-09-06T15:14:27.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.182+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f13cc005d60 con 0x7f13e410d640 2024-09-06T15:14:27.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.186+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c40050b0 con 0x7f13e410d640 2024-09-06T15:14:27.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.186+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f13cc0038c0 con 0x7f13e410d640 2024-09-06T15:14:27.182 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.186+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f13cc094e90 con 0x7f13e410d640 2024-09-06T15:14:27.185 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.190+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f13cc05de10 con 0x7f13e410d640 2024-09-06T15:14:27.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.354+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13c40053a0 con 0x7f13e410d640 2024-09-06T15:14:27.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.354+0000 7f13e17fa640 1 -- 172.21.15.189:0/2120101365 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+20949 (unknown 2365082500 0 1339343519) 0x7f13cc061f80 con 0x7f13e410d640 2024-09-06T15:14:27.351 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:14:27.351 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":67,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","created":"2024-09-06T15:02:37.979633+0000","modified":"2024-09-06T15:13:49.760400+0000","last_up_change":"2024-09-06T15:12:22.284553+0000","last_in_change":"2024-09-06T15:11:52.395223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T15:07:52.507824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-06T15:12:53.216308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-06T15:12:55.214379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-09-06T15:12:56.194832+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-06T15:12:57.127740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-06T15:12:59.228188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d92afed7-3bbd-4d81-ace9-acfee64fc0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":775653131}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":775653131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":775653131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":775653131}]},"public_addr":"172.21.15.189:6801/775653131","cluster_addr":"172.21.15.189:6802/775653131","heartbeat_back_addr":"172.21.15.189:6804/775653131","heartbeat_front_addr":"172.21.15.189:6803/775653131","state":["exists","up"]},{"osd":1,"uuid":"2c5618ea-0301-4c3b-b1be-b5f13141d301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":2081655191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":2081655191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":2081655191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":2081655191}]},"public_addr":"172.21.15.189:6805/2081655191","cluster_addr":"172.21.15.189:6806/2081655191","heartbeat_back_addr":"172.21.15.189:6808/2081655191","heartbeat_front_addr":"172.21.15.189:6807/2081655191","state":["exists","up"]},{"osd":2,"uuid":"8f49d03c-eab1-4700-bea3-7a6c5c80a1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":2943648838}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":2943648838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6812","nonce":2943648838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":2943648838}]},"public_addr":"172.21.15.189:6809/2943648838","cluster_addr":"172.21.15.189:6810/2943648838","heartbeat_back_addr":"172.21.15.189:6812/2943648838","heartbeat_front_addr":"172.21.15.189:6811/2943648838","state":["exists","up"]},{"osd":3,"uuid":"4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6813","nonce":3926696354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6814","nonce":3926696354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6816","nonce":3926696354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6815","nonce":3926696354}]},"public_addr":"172.21.15.189:6813/3926696354","cluster_addr":"172.21.15.189:6814/3926696354","heartbeat_back_addr":"172.21.15.189:6816/3926696354","heartbeat_front_addr":"172.21.15.189:6815/3926696354","state":["exists","up"]},{"osd":4,"uuid":"f5ba07bb-3fc6-4137-8006-cee2d487a9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6800","nonce":2144496764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6801","nonce":2144496764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6803","nonce":2144496764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6802","nonce":2144496764}]},"public_addr":"172.21.15.190:6800/2144496764","cluster_addr":"172.21.15.190:6801/2144496764","heartbeat_back_addr":"172.21.15.190:6803/2144496764","heartbeat_front_addr":"172.21.15.190:6802/2144496764","state":["exists","up"]},{"osd":5,"uuid":"30ac143b-0f07-4633-8b54-941c8129c409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6804","nonce":1567707916}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6805","nonce":1567707916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6807","nonce":1567707916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6806","nonce":1567707916}]},"public_addr":"172.21.15.190:6804/1567707916","cluster_addr":"172.21.15.190:6805/1567707916","heartbeat_back_addr":"172.21.15.190:6807/1567707916","heartbeat_front_addr":"172.21.15.190:6806/1567707916","state":["exists","up"]},{"osd":6,"uuid":"ace6a61d-47ae-4d92-83c4-7f49e30714bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6808","nonce":507475988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6809","nonce":507475988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6811","nonce":507475988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6810","nonce":507475988}]},"public_addr":"172.21.15.190:6808/507475988","cluster_addr":"172.21.15.190:6809/507475988","heartbeat_back_addr":"172.21.15.190:6811/507475988","heartbeat_front_addr":"172.21.15.190:6810/507475988","state":["exists","up"]},{"osd":7,"uuid":"46d1d9ea-f721-4edf-9377-0c7bea4ea700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6812","nonce":2054184397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6813","nonce":2054184397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6815","nonce":2054184397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6814","nonce":2054184397}]},"public_addr":"172.21.15.190:6812/2054184397","cluster_addr":"172.21.15.190:6813/2054184397","heartbeat_back_addr":"172.21.15.190:6815/2054184397","heartbeat_front_addr":"172.21.15.190:6814/2054184397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:00.300078+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:53.550765+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:07:48.725148+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:08:42.865141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:09:35.611162+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:10:29.520805+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:11:23.112514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:12:21.251019+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:0/3475975263":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/3829376948":"2024-09-07T15:03:38.092560+0000","172.21.15.189:6800/4002094494":"2024-09-07T15:13:49.760363+0000","172.21.15.189:6800/1474022696":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/582841293":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/2479859654":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/1750887384":"2024-09-07T15:03:05.048425+0000","172.21.15.189:6800/843694021":"2024-09-07T15:03:05.048425+0000","172.21.15.189:0/2444982546":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/3508628999":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/1510466136":"2024-09-07T15:03:05.048425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T15:14:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 >> v1:172.21.15.189:6800/1420554776 conn(0x7f13d00783b0 legacy=0x7f13d007a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 >> v1:172.21.15.189:6790/0 conn(0x7f13e410d640 legacy=0x7f13e41a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:27.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 shutdown_connections 2024-09-06T15:14:27.353 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 >> 172.21.15.189:0/2120101365 conn(0x7f13e4100520 msgr2=0x7f13e41082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:27.353 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 shutdown_connections 2024-09-06T15:14:27.353 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:27.358+0000 7f13ea34d640 1 -- 172.21.15.189:0/2120101365 wait complete. 2024-09-06T15:14:27.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:27 smithi189 bash[22757]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:27 smithi189 bash[22757]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:27 smithi189 bash[29727]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:27 smithi189 bash[29727]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:27 smithi190 bash[24979]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.872 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:27 smithi190 bash[24979]: audit 2024-09-06T15:14:27.355666+0000 mon.c (mon.2) 58 : audit [DBG] from='client.? v1:172.21.15.189:0/2120101365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:27.963 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-06T15:14:27.963 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T15:14:28.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:28 smithi189 bash[22757]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:28.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:28 smithi189 bash[22757]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:28.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:28 smithi189 bash[29727]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:28.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:28 smithi189 bash[29727]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:28.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:28 smithi190 bash[24979]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:28.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:28 smithi190 bash[24979]: cluster 2024-09-06T15:14:27.802695+0000 mgr.y (mgr.14631) 50 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:29 smithi189 bash[29727]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:29 smithi189 bash[29727]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:29 smithi189 bash[22757]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:29 smithi189 bash[22757]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:29 smithi190 bash[24979]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:30.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:29 smithi190 bash[24979]: cluster 2024-09-06T15:14:29.803392+0000 mgr.y (mgr.14631) 51 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:31.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:30 smithi190 bash[24979]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:31.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:30 smithi190 bash[24979]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:31.122 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:30 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:31.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:30 smithi189 bash[22757]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:31.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:30 smithi189 bash[22757]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:31.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:30 smithi189 bash[29727]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:31.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:30 smithi189 bash[29727]: audit 2024-09-06T15:14:30.818711+0000 mgr.y (mgr.14631) 52 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:32.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:31 smithi189 bash[22757]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:31 smithi189 bash[22757]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:31 smithi189 bash[29727]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:31 smithi189 bash[29727]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:31 smithi190 bash[24979]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:31 smithi190 bash[24979]: cluster 2024-09-06T15:14:31.804898+0000 mgr.y (mgr.14631) 53 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:32.753 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:33.621 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.622 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.622 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.622 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.623 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.623 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.623 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.623 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.624 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.887 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.888 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.888 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.888 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.888 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.888 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.889 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.889 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.889 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.890 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.890 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.890 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.890 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:14:33.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/2107570993 >> v1:172.21.15.189:6790/0 conn(0x7ff10410efd0 legacy=0x7ff104111490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:33.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/2107570993 shutdown_connections 2024-09-06T15:14:33.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/2107570993 >> 172.21.15.189:0/2107570993 conn(0x7ff1040fe330 msgr2=0x7ff104100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:33.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/2107570993 shutdown_connections 2024-09-06T15:14:33.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/2107570993 wait complete. 2024-09-06T15:14:33.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 Processor -- start 2024-09-06T15:14:33.930 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- start start 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff1041a96f0 con 0x7ff10410b430 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff1041aa8f0 con 0x7ff10410efd0 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff1041abaf0 con 0x7ff1041028c0 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff108e70640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7ff1041028c0 0x7ff104076a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:37948/0 (socket says 172.21.15.189:37948) 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff108e70640 1 -- 172.21.15.189:0/3561854813 learned_addr learned my addr 172.21.15.189:0/3561854813 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97533168 0 0) 0x7ff1041a96f0 con 0x7ff10410b430 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0ec003160 con 0x7ff10410b430 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440589291 0 0) 0x7ff1041abaf0 con 0x7ff1041028c0 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1041a96f0 con 0x7ff1041028c0 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2292700236 0 0) 0x7ff1041a96f0 con 0x7ff1041028c0 2024-09-06T15:14:33.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1041abaf0 con 0x7ff1041028c0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687532285 0 0) 0x7ff1041aa8f0 con 0x7ff10410efd0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1041a96f0 con 0x7ff10410efd0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff1000019f0 con 0x7ff1041028c0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4277076969 0 0) 0x7ff0ec003160 con 0x7ff10410b430 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1041aa8f0 con 0x7ff10410b430 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff0f40011a0 con 0x7ff10410b430 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2450567062 0 0) 0x7ff1041a96f0 con 0x7ff10410efd0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0ec003160 con 0x7ff10410efd0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 664168354 0 0) 0x7ff1041abaf0 con 0x7ff1041028c0 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 >> v1:172.21.15.190:6789/0 conn(0x7ff10410efd0 legacy=0x7ff1041a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:33.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 >> v1:172.21.15.189:6789/0 conn(0x7ff10410b430 legacy=0x7ff1041a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:33.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1041acd90 con 0x7ff1041028c0 2024-09-06T15:14:33.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1041abd20 con 0x7ff1041028c0 2024-09-06T15:14:33.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1041ac350 con 0x7ff1041028c0 2024-09-06T15:14:33.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7ff100001cd0 con 0x7ff1041028c0 2024-09-06T15:14:33.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.934+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff100005b90 con 0x7ff1041028c0 2024-09-06T15:14:33.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.938+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f00050b0 con 0x7ff1041028c0 2024-09-06T15:14:33.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.938+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7ff1000038c0 con 0x7ff1041028c0 2024-09-06T15:14:33.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.938+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7ff100094d00 con 0x7ff1041028c0 2024-09-06T15:14:33.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:33.942+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ff10005dc80 con 0x7ff1041028c0 2024-09-06T15:14:34.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:33 smithi189 bash[29727]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:33 smithi189 bash[29727]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:33 smithi189 bash[22757]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:33 smithi189 bash[22757]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.112 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.118+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0f00053a0 con 0x7ff1041028c0 2024-09-06T15:14:34.114 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.118+0000 7ff0f9ffb640 1 -- 172.21.15.189:0/3561854813 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+20949 (unknown 2365082500 0 1339343519) 0x7ff100061df0 con 0x7ff1041028c0 2024-09-06T15:14:34.114 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:14:34.114 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":67,"fsid":"de31ad16-6c60-11ef-bce4-c7b262605968","created":"2024-09-06T15:02:37.979633+0000","modified":"2024-09-06T15:13:49.760400+0000","last_up_change":"2024-09-06T15:12:22.284553+0000","last_in_change":"2024-09-06T15:11:52.395223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T15:07:52.507824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-06T15:12:53.216308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-06T15:12:55.214379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-09-06T15:12:56.194832+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":63,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-09-06T15:12:57.127740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-06T15:12:59.228188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d92afed7-3bbd-4d81-ace9-acfee64fc0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":775653131}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":775653131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":775653131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":775653131}]},"public_addr":"172.21.15.189:6801/775653131","cluster_addr":"172.21.15.189:6802/775653131","heartbeat_back_addr":"172.21.15.189:6804/775653131","heartbeat_front_addr":"172.21.15.189:6803/775653131","state":["exists","up"]},{"osd":1,"uuid":"2c5618ea-0301-4c3b-b1be-b5f13141d301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":2081655191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":2081655191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":2081655191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":2081655191}]},"public_addr":"172.21.15.189:6805/2081655191","cluster_addr":"172.21.15.189:6806/2081655191","heartbeat_back_addr":"172.21.15.189:6808/2081655191","heartbeat_front_addr":"172.21.15.189:6807/2081655191","state":["exists","up"]},{"osd":2,"uuid":"8f49d03c-eab1-4700-bea3-7a6c5c80a1f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":2943648838}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":2943648838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6812","nonce":2943648838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":2943648838}]},"public_addr":"172.21.15.189:6809/2943648838","cluster_addr":"172.21.15.189:6810/2943648838","heartbeat_back_addr":"172.21.15.189:6812/2943648838","heartbeat_front_addr":"172.21.15.189:6811/2943648838","state":["exists","up"]},{"osd":3,"uuid":"4d2d98f4-c7a1-4531-b3f5-2bbc11d2817f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6813","nonce":3926696354}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6814","nonce":3926696354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6816","nonce":3926696354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6815","nonce":3926696354}]},"public_addr":"172.21.15.189:6813/3926696354","cluster_addr":"172.21.15.189:6814/3926696354","heartbeat_back_addr":"172.21.15.189:6816/3926696354","heartbeat_front_addr":"172.21.15.189:6815/3926696354","state":["exists","up"]},{"osd":4,"uuid":"f5ba07bb-3fc6-4137-8006-cee2d487a9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6800","nonce":2144496764}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6801","nonce":2144496764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6803","nonce":2144496764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6802","nonce":2144496764}]},"public_addr":"172.21.15.190:6800/2144496764","cluster_addr":"172.21.15.190:6801/2144496764","heartbeat_back_addr":"172.21.15.190:6803/2144496764","heartbeat_front_addr":"172.21.15.190:6802/2144496764","state":["exists","up"]},{"osd":5,"uuid":"30ac143b-0f07-4633-8b54-941c8129c409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6804","nonce":1567707916}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6805","nonce":1567707916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6807","nonce":1567707916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6806","nonce":1567707916}]},"public_addr":"172.21.15.190:6804/1567707916","cluster_addr":"172.21.15.190:6805/1567707916","heartbeat_back_addr":"172.21.15.190:6807/1567707916","heartbeat_front_addr":"172.21.15.190:6806/1567707916","state":["exists","up"]},{"osd":6,"uuid":"ace6a61d-47ae-4d92-83c4-7f49e30714bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6808","nonce":507475988}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6809","nonce":507475988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6811","nonce":507475988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6810","nonce":507475988}]},"public_addr":"172.21.15.190:6808/507475988","cluster_addr":"172.21.15.190:6809/507475988","heartbeat_back_addr":"172.21.15.190:6811/507475988","heartbeat_front_addr":"172.21.15.190:6810/507475988","state":["exists","up"]},{"osd":7,"uuid":"46d1d9ea-f721-4edf-9377-0c7bea4ea700","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6812","nonce":2054184397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6813","nonce":2054184397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6815","nonce":2054184397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.190:6814","nonce":2054184397}]},"public_addr":"172.21.15.190:6812/2054184397","cluster_addr":"172.21.15.190:6813/2054184397","heartbeat_back_addr":"172.21.15.190:6815/2054184397","heartbeat_front_addr":"172.21.15.190:6814/2054184397","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:00.300078+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:06:53.550765+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:07:48.725148+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:08:42.865141+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:09:35.611162+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:10:29.520805+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:11:23.112514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T15:12:21.251019+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.189:0/3475975263":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/3829376948":"2024-09-07T15:03:38.092560+0000","172.21.15.189:6800/4002094494":"2024-09-07T15:13:49.760363+0000","172.21.15.189:6800/1474022696":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/582841293":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/2479859654":"2024-09-07T15:03:38.092560+0000","172.21.15.189:0/1750887384":"2024-09-07T15:03:05.048425+0000","172.21.15.189:6800/843694021":"2024-09-07T15:03:05.048425+0000","172.21.15.189:0/2444982546":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/3508628999":"2024-09-07T15:13:49.760363+0000","172.21.15.189:0/1510466136":"2024-09-07T15:03:05.048425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T15:14:34.116 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 >> v1:172.21.15.189:6800/1420554776 conn(0x7ff0ec078590 legacy=0x7ff0ec07aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:34.116 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 >> v1:172.21.15.189:6790/0 conn(0x7ff1041028c0 legacy=0x7ff104076a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:34.116 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 shutdown_connections 2024-09-06T15:14:34.117 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 >> 172.21.15.189:0/3561854813 conn(0x7ff1040fe330 msgr2=0x7ff1041060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:34.117 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 shutdown_connections 2024-09-06T15:14:34.117 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:34.122+0000 7ff10b0d4640 1 -- 172.21.15.189:0/3561854813 wait complete. 2024-09-06T15:14:34.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:33 smithi190 systemd[1]: Started Ceph grafana.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:34.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:33 smithi190 bash[24979]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:33 smithi190 bash[24979]: cluster 2024-09-06T15:14:33.805403+0000 mgr.y (mgr.14631) 54 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:34.768 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-06T15:14:34.769 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-06T15:14:34.769 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-06T15:14:34.769 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-06T15:14:34.770 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-06T15:14:34.770 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-06T15:14:34.771 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-06T15:14:34.771 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-06T15:14:35.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[22757]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:34 smithi189 bash[29727]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.258 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.948728+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.954139+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.958716+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:33.967444+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.004260+0000 mon.c (mon.2) 59 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.119540+0000 mon.c (mon.2) 60 : audit [DBG] from='client.? v1:172.21.15.189:0/3561854813' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-06T15:14:35.260 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.261 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.563267+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.261 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.261 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:34 smithi190 bash[24979]: audit 2024-09-06T15:14:34.572827+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:35.531 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.26722267Z level=info msg="Starting Grafana" version=10.4.0 commit=03f502a94d17f7dc4e6c34acdf8428aedd986e4c branch=HEAD compiled=2024-09-06T15:14:35Z 2024-09-06T15:14:35.531 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267485841Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-09-06T15:14:35.531 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267495254Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-09-06T15:14:35.531 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267498609Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267504557Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267516903Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267523879Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267528792Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267533752Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267538366Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267542893Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267547639Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267552322Z level=info msg=Target target=[all] 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267560771Z level=info msg="Path Home" path=/usr/share/grafana 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267566276Z level=info msg="Path Data" path=/var/lib/grafana 2024-09-06T15:14:35.532 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267570867Z level=info msg="Path Logs" path=/var/log/grafana 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267575598Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267580444Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=settings t=2024-09-06T15:14:35.267585326Z level=info msg="App mode production" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=sqlstore t=2024-09-06T15:14:35.268732719Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=sqlstore t=2024-09-06T15:14:35.268767205Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.270224696Z level=info msg="Starting DB migrations" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.271367876Z level=info msg="Executing migration" id="create migration_log table" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.272485187Z level=info msg="Migration successfully executed" id="create migration_log table" duration=1.103275ms 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.312962009Z level=info msg="Executing migration" id="create user table" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.314752115Z level=info msg="Migration successfully executed" id="create user table" duration=1.787549ms 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.363176489Z level=info msg="Executing migration" id="add unique index user.login" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.364681234Z level=info msg="Migration successfully executed" id="add unique index user.login" duration=1.506319ms 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.39682131Z level=info msg="Executing migration" id="add unique index user.email" 2024-09-06T15:14:35.533 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.398360035Z level=info msg="Migration successfully executed" id="add unique index user.email" duration=1.540362ms 2024-09-06T15:14:35.534 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.476793625Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-09-06T15:14:35.534 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.478255828Z level=info msg="Migration successfully executed" id="drop index UQE_user_login - v1" duration=1.462423ms 2024-09-06T15:14:35.534 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.513970066Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-09-06T15:14:35.534 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.515383892Z level=info msg="Migration successfully executed" id="drop index UQE_user_email - v1" duration=1.414273ms 2024-09-06T15:14:35.534 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.539219232Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-06T15:14:35.817 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.543974122Z level=info msg="Migration successfully executed" id="Rename table user to user_v1 - v1" duration=4.75361ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.56442054Z level=info msg="Executing migration" id="create user table v2" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.566114956Z level=info msg="Migration successfully executed" id="create user table v2" duration=1.690464ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.581331478Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.582757491Z level=info msg="Migration successfully executed" id="create index UQE_user_login - v2" duration=1.431926ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.598132511Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.599545227Z level=info msg="Migration successfully executed" id="create index UQE_user_email - v2" duration=1.403096ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.61526146Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.616114251Z level=info msg="Migration successfully executed" id="copy data_source v1 to v2" duration=851.939µs 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.632061752Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.633226341Z level=info msg="Migration successfully executed" id="Drop old table user_v1" duration=1.163599ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.648941821Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.651191072Z level=info msg="Migration successfully executed" id="Add column help_flags1 to user table" duration=2.248061ms 2024-09-06T15:14:35.818 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.674108262Z level=info msg="Executing migration" id="Update user table charset" 2024-09-06T15:14:35.819 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.674160911Z level=info msg="Migration successfully executed" id="Update user table charset" duration=54.846µs 2024-09-06T15:14:40.733 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.699681672Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.701860587Z level=info msg="Migration successfully executed" id="Add last_seen_at column to user" duration=2.177969ms 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.741738181Z level=info msg="Executing migration" id="Add missing user data" 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.74224435Z level=info msg="Migration successfully executed" id="Add missing user data" duration=503.972µs 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.783574276Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.785839244Z level=info msg="Migration successfully executed" id="Add is_disabled column to user" duration=2.265931ms 2024-09-06T15:14:40.734 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.825718765Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-06T15:14:40.735 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.735 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.735 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.735 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.735 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.736 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[22757]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.827272893Z level=info msg="Migration successfully executed" id="Add index user.login/user.email" duration=1.553319ms 2024-09-06T15:14:40.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.850972834Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-06T15:14:40.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.853221282Z level=info msg="Migration successfully executed" id="Add is_service_account column to user" duration=2.260208ms 2024-09-06T15:14:40.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.876155308Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.891420856Z level=info msg="Migration successfully executed" id="Update is_service_account column to nullable" duration=15.268571ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.918055212Z level=info msg="Executing migration" id="Add uid column to user" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.92035757Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=2.302767ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.943229613Z level=info msg="Executing migration" id="Update uid column values for users" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.943669953Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=439.782µs 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.968505433Z level=info msg="Executing migration" id="Add unique index user_uid" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.970002429Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=1.497983ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.993921798Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:35 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:35.995520949Z level=info msg="Migration successfully executed" id="create temp user table v1-7" duration=1.598274ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.035943328Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.037437967Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v1-7" duration=1.490742ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.061069842Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.062593315Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v1-7" duration=1.515265ms 2024-09-06T15:14:40.737 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.086051479Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:36 smithi189 bash[29727]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.738 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.739 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: audit 2024-09-06T15:14:35.137208+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.739 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.739 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: audit 2024-09-06T15:14:35.227559+0000 mon.c (mon.2) 61 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:40.739 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.739 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[24979]: cluster 2024-09-06T15:14:35.806815+0000 mgr.y (mgr.14631) 55 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:40.740 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:37 smithi189 bash[22757]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.740 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:37 smithi189 bash[22757]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:37 smithi189 bash[29727]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:37 smithi189 bash[29727]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.741 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.742 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.743 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.744 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.744 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.087040712Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v1-7" duration=989.189µs 2024-09-06T15:14:40.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.111437128Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-06T15:14:40.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.112213129Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v1-7" duration=771.267µs 2024-09-06T15:14:40.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.136794446Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.136832374Z level=info msg="Migration successfully executed" id="Update temp_user table charset" duration=30.169µs 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.178893125Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.179725365Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_email - v1" duration=834.175µs 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.220783239Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.221680569Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_org_id - v1" duration=894.446µs 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.254522568Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.25538691Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_code - v1" duration=867.697µs 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.279830334Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.281187444Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_status - v1" duration=1.355364ms 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.305265246Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-06T15:14:40.746 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.311500132Z level=info msg="Migration successfully executed" id="Rename table temp_user to temp_user_tmp_qwerty - v1" duration=6.227569ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.355323687Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.357246818Z level=info msg="Migration successfully executed" id="create temp_user v2" duration=1.922344ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.397299704Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.398862139Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v2" duration=1.562062ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.430937535Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.432404227Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v2" duration=1.469315ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.456156652Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.457656617Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v2" duration=1.492452ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.498035613Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.499569495Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v2" duration=1.536642ms 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.523517495Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.524349257Z level=info msg="Migration successfully executed" id="copy temp_user v1 to v2" duration=830.989µs 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.548549744Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-06T15:14:40.747 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.549747492Z level=info msg="Migration successfully executed" id="drop temp_user_tmp_qwerty" duration=1.151519ms 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.573821494Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.574591016Z level=info msg="Migration successfully executed" id="Set created for temp users that will otherwise prematurely expire" duration=768.873µs 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.599062448Z level=info msg="Executing migration" id="create star table" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.600366182Z level=info msg="Migration successfully executed" id="create star table" duration=1.302787ms 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.624305864Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.625887282Z level=info msg="Migration successfully executed" id="add unique index star.user_id_dashboard_id" duration=1.580552ms 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.649936454Z level=info msg="Executing migration" id="create org table v1" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.651547185Z level=info msg="Migration successfully executed" id="create org table v1" duration=1.609764ms 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.675068512Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.676630767Z level=info msg="Migration successfully executed" id="create index UQE_org_name - v1" duration=1.561568ms 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.717012776Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-06T15:14:40.748 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.718550648Z level=info msg="Migration successfully executed" id="create org_user table v1" duration=1.536855ms 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.73396365Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.735566662Z level=info msg="Migration successfully executed" id="create index IDX_org_user_org_id - v1" duration=1.602605ms 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.750811673Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.752484953Z level=info msg="Migration successfully executed" id="create index UQE_org_user_org_id_user_id - v1" duration=1.672217ms 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.767797707Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.769360115Z level=info msg="Migration successfully executed" id="create index IDX_org_user_user_id - v1" duration=1.561319ms 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.801376413Z level=info msg="Executing migration" id="Update org table charset" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.801429732Z level=info msg="Migration successfully executed" id="Update org table charset" duration=55.599µs 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.835003961Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.835057394Z level=info msg="Migration successfully executed" id="Update org_user table charset" duration=55.23µs 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.860269521Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.860661777Z level=info msg="Migration successfully executed" id="Migrate all Read Only Viewers to Viewers" duration=387.753µs 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.902189231Z level=info msg="Executing migration" id="create dashboard table" 2024-09-06T15:14:40.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.903717363Z level=info msg="Migration successfully executed" id="create dashboard table" duration=1.524835ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.927589197Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.929148514Z level=info msg="Migration successfully executed" id="add index dashboard.account_id" duration=1.555857ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.952784881Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.954498744Z level=info msg="Migration successfully executed" id="add unique index dashboard_account_id_slug" duration=1.709939ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.97803215Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:36 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:36.979395254Z level=info msg="Migration successfully executed" id="create dashboard_tag table" duration=1.36266ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.020049381Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.021634022Z level=info msg="Migration successfully executed" id="add unique index dashboard_tag.dasboard_id_term" duration=1.584325ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.045272448Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.046779797Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" duration=1.506406ms 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.070528208Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-06T15:14:40.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.081169325Z level=info msg="Migration successfully executed" id="Rename table dashboard to dashboard_v1 - v1" duration=10.639246ms 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.103925057Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.104937692Z level=info msg="Migration successfully executed" id="create dashboard v2" duration=1.012548ms 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.146035765Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.147580716Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_org_id - v2" duration=1.544465ms 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.18818931Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.189940956Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_org_id_slug - v2" duration=1.75038ms 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.230206784Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.231078948Z level=info msg="Migration successfully executed" id="copy dashboard v1 to v2" duration=872.171µs 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.25547255Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.257565827Z level=info msg="Migration successfully executed" id="drop table dashboard_v1" duration=2.09191ms 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.297400481Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.297627832Z level=info msg="Migration successfully executed" id="alter dashboard.data to mediumtext v1" duration=229.328µs 2024-09-06T15:14:40.751 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.322611665Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.3261904Z level=info msg="Migration successfully executed" id="Add column updated_by in dashboard - v2" duration=3.581671ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.347862672Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.351358145Z level=info msg="Migration successfully executed" id="Add column created_by in dashboard - v2" duration=3.492639ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.389815973Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.393326792Z level=info msg="Migration successfully executed" id="Add column gnetId in dashboard" duration=3.510046ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.431810977Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.433338722Z level=info msg="Migration successfully executed" id="Add index for gnetId in dashboard" duration=1.527422ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.457056473Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.46074037Z level=info msg="Migration successfully executed" id="Add column plugin_id in dashboard" duration=3.682837ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.498998627Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.500594265Z level=info msg="Migration successfully executed" id="Add index for plugin_id in dashboard" duration=1.594891ms 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.524249964Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-06T15:14:40.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.525845212Z level=info msg="Migration successfully executed" id="Add index for dashboard_id in dashboard_tag" duration=1.594765ms 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.54959899Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.549649749Z level=info msg="Migration successfully executed" id="Update dashboard table charset" duration=52.946µs 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.575037812Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.575092982Z level=info msg="Migration successfully executed" id="Update dashboard_tag table charset" duration=57.077µs 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.600319492Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.604396183Z level=info msg="Migration successfully executed" id="Add column folder_id in dashboard" duration=4.076328ms 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.625551397Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.627259331Z level=info msg="Migration successfully executed" id="Add column isFolder in dashboard" duration=1.70991ms 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.650624105Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.65214465Z level=info msg="Migration successfully executed" id="Add column has_acl in dashboard" duration=1.520425ms 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.692513843Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-06T15:14:40.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.694199726Z level=info msg="Migration successfully executed" id="Add column uid in dashboard" duration=1.686106ms 2024-09-06T15:14:40.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.717789892Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-06T15:14:40.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.717995542Z level=info msg="Migration successfully executed" id="Update uid column values in dashboard" duration=205.856µs 2024-09-06T15:14:40.754 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.754 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[24979]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.754 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[24979]: cluster 2024-09-06T15:14:37.807567+0000 mgr.y (mgr.14631) 56 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.754 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.755 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:40.756 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.743182671Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-06T15:14:40.756 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.743909336Z level=info msg="Migration successfully executed" id="Add unique index dashboard_org_id_uid" duration=732.968µs 2024-09-06T15:14:40.756 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.78533157Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.786852005Z level=info msg="Migration successfully executed" id="Remove unique index org_id_slug" duration=1.520095ms 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.802101926Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.802175013Z level=info msg="Migration successfully executed" id="Update dashboard title length" duration=59.32µs 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.835887423Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.837425694Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_title_folder_id" duration=1.537438ms 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.852842348Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.854337966Z level=info msg="Migration successfully executed" id="create dashboard_provisioning" duration=1.495432ms 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.88644204Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-06T15:14:40.757 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.895996953Z level=info msg="Migration successfully executed" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" duration=9.554213ms 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.936892321Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.938493312Z level=info msg="Migration successfully executed" id="create dashboard_provisioning v2" duration=1.600717ms 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.962185011Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:37 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:37.963788132Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id - v2" duration=1.600432ms 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.004096258Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.005848858Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" duration=1.751796ms 2024-09-06T15:14:40.758 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.029392825Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.030140861Z level=info msg="Migration successfully executed" id="copy dashboard_provisioning v1 to v2" duration=748.665µs 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.05448787Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.055821678Z level=info msg="Migration successfully executed" id="drop dashboard_provisioning_tmp_qwerty" duration=1.333187ms 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.079755907Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.083755695Z level=info msg="Migration successfully executed" id="Add check_sum column" duration=4.000134ms 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.104913849Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.106836626Z level=info msg="Migration successfully executed" id="Add index for dashboard_title" duration=1.923814ms 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.130161279Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.130584344Z level=info msg="Migration successfully executed" id="delete tags for deleted dashboards" duration=420.283µs 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.172159149Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.172567689Z level=info msg="Migration successfully executed" id="delete stars for deleted dashboards" duration=407.383µs 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.197366907Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-06T15:14:40.759 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.199112523Z level=info msg="Migration successfully executed" id="Add index for dashboard_is_folder" duration=1.744857ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.239410037Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.24387195Z level=info msg="Migration successfully executed" id="Add isPublic for dashboard" duration=4.462874ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.281401824Z level=info msg="Executing migration" id="create data_source table" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.283469067Z level=info msg="Migration successfully executed" id="create data_source table" duration=2.066046ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.323415041Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.325122924Z level=info msg="Migration successfully executed" id="add index data_source.account_id" duration=1.708893ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.348582249Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.350352305Z level=info msg="Migration successfully executed" id="add unique index data_source.account_id_name" duration=1.771439ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.373877842Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.375428117Z level=info msg="Migration successfully executed" id="drop index IDX_data_source_account_id - v1" duration=1.548628ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.41578244Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.417302732Z level=info msg="Migration successfully executed" id="drop index UQE_data_source_account_id_name - v1" duration=1.517878ms 2024-09-06T15:14:40.760 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.4410611Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.452003046Z level=info msg="Migration successfully executed" id="Rename table data_source to data_source_v1 - v1" duration=10.940779ms 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.491328993Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.493188818Z level=info msg="Migration successfully executed" id="create data_source table v2" duration=1.859352ms 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.516877973Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.51858343Z level=info msg="Migration successfully executed" id="create index IDX_data_source_org_id - v2" duration=1.705087ms 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.542030758Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.544075995Z level=info msg="Migration successfully executed" id="create index UQE_data_source_org_id_name - v2" duration=2.044003ms 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.55898346Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.560218611Z level=info msg="Migration successfully executed" id="Drop old table data_source_v1 #2" duration=1.234538ms 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.592549388Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-06T15:14:40.761 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.596974949Z level=info msg="Migration successfully executed" id="Add column with_credentials" duration=4.424955ms 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.609529536Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.614165645Z level=info msg="Migration successfully executed" id="Add secure json data column" duration=4.634759ms 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.643174408Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.643234194Z level=info msg="Migration successfully executed" id="Update data_source table charset" duration=55.67µs 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.668377993Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.668777932Z level=info msg="Migration successfully executed" id="Update initial version to 1" duration=400.07µs 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.710387129Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.715408977Z level=info msg="Migration successfully executed" id="Add read_only data column" duration=5.022868ms 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.785863143Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.786297148Z level=info msg="Migration successfully executed" id="Migrate logging ds to loki ds" duration=435.246µs 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.802818608Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.803204001Z level=info msg="Migration successfully executed" id="Update json_data with nulls" duration=386.296µs 2024-09-06T15:14:40.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.844674643Z level=info msg="Executing migration" id="Add uid column" 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.849096483Z level=info msg="Migration successfully executed" id="Add uid column" duration=4.42053ms 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.869974756Z level=info msg="Executing migration" id="Update uid value" 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.870416942Z level=info msg="Migration successfully executed" id="Update uid value" duration=442.428µs 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.895237976Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.896871334Z level=info msg="Migration successfully executed" id="Add unique index datasource_org_id_uid" duration=1.632718ms 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.937218671Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.938818241Z level=info msg="Migration successfully executed" id="add unique index datasource_org_id_is_default" duration=1.598287ms 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.962419691Z level=info msg="Executing migration" id="create api_key table" 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:38 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:38.964086924Z level=info msg="Migration successfully executed" id="create api_key table" duration=1.665973ms 2024-09-06T15:14:40.763 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.004449841Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.006160444Z level=info msg="Migration successfully executed" id="add index api_key.account_id" duration=1.708216ms 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.029717611Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.031311916Z level=info msg="Migration successfully executed" id="add index api_key.key" duration=1.593928ms 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.055071311Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.056930286Z level=info msg="Migration successfully executed" id="add index api_key.account_id_name" duration=1.855365ms 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.080274288Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.081930702Z level=info msg="Migration successfully executed" id="drop index IDX_api_key_account_id - v1" duration=1.65659ms 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.13067149Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.132135504Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_key - v1" duration=1.467362ms 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.155848735Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-06T15:14:40.764 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.156900975Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_account_id_name - v1" duration=1.065973ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.189358446Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.197797728Z level=info msg="Migration successfully executed" id="Rename table api_key to api_key_v1 - v1" duration=8.436504ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.231350235Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.232383975Z level=info msg="Migration successfully executed" id="create api_key table v2" duration=1.032982ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.265093717Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.266727578Z level=info msg="Migration successfully executed" id="create index IDX_api_key_org_id - v2" duration=1.633457ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.298711029Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.300288336Z level=info msg="Migration successfully executed" id="create index UQE_api_key_key - v2" duration=1.576727ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.332288898Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.333996192Z level=info msg="Migration successfully executed" id="create index UQE_api_key_org_id_name - v2" duration=1.706297ms 2024-09-06T15:14:40.765 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.365873664Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.366659589Z level=info msg="Migration successfully executed" id="copy api_key v1 to v2" duration=785.862µs 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.39942107Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.400636852Z level=info msg="Migration successfully executed" id="Drop old table api_key_v1" duration=1.214368ms 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.441406255Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.441513657Z level=info msg="Migration successfully executed" id="Update api_key table charset" duration=107.832µs 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.483620609Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.488280637Z level=info msg="Migration successfully executed" id="Add expires to api_key table" duration=4.658841ms 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.508968706Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.513604697Z level=info msg="Migration successfully executed" id="Add service account foreign key" duration=4.631081ms 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.542551062Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-06T15:14:40.766 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.542888062Z level=info msg="Migration successfully executed" id="set service account foreign key to nil if 0" duration=336.423µs 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.567767262Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.572429027Z level=info msg="Migration successfully executed" id="Add last_used_at to api_key table" duration=4.661051ms 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.601392391Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.60662809Z level=info msg="Migration successfully executed" id="Add is_revoked column to api_key table" duration=5.238008ms 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.634945007Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.636510219Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v4" duration=1.564395ms 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.660031738Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.660859864Z level=info msg="Migration successfully executed" id="drop table dashboard_snapshot_v4 #1" duration=827.273µs 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.685194408Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.686150149Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v5 #2" duration=955.611µs 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.710440318Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-06T15:14:40.767 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.711252862Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_key - v5" duration=812.25µs 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.752391663Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.753243159Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_snapshot_delete_key - v5" duration=853.028µs 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.836344644Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.837175559Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_snapshot_user_id - v5" duration=832.203µs 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.861561427Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.861660659Z level=info msg="Migration successfully executed" id="alter dashboard_snapshot to mediumtext v2" duration=101.427µs 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.886836496Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.886891489Z level=info msg="Migration successfully executed" id="Update dashboard_snapshot table charset" duration=58.969µs 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.911992535Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.914031059Z level=info msg="Migration successfully executed" id="Add column external_delete_url to dashboard_snapshots table" duration=2.038631ms 2024-09-06T15:14:40.768 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.937338599Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.939388619Z level=info msg="Migration successfully executed" id="Add encrypted dashboard json column" duration=2.051763ms 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.979412685Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:39 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:39.97952232Z level=info msg="Migration successfully executed" id="Change dashboard_encrypted column to MEDIUMBLOB" duration=110.988µs 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.021387374Z level=info msg="Executing migration" id="create quota table v1" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.022167065Z level=info msg="Migration successfully executed" id="create quota table v1" duration=783.965µs 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.188843743Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.18980594Z level=info msg="Migration successfully executed" id="create index UQE_quota_org_id_user_id_target - v1" duration=963.196µs 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.272566943Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.272605697Z level=info msg="Migration successfully executed" id="Update quota table charset" duration=44.374µs 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.364800313Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.365672098Z level=info msg="Migration successfully executed" id="create plugin_setting table" duration=873.427µs 2024-09-06T15:14:40.769 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.432029601Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.433839611Z level=info msg="Migration successfully executed" id="create index UQE_plugin_setting_org_id_plugin_id - v1" duration=1.810459ms 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.457085838Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.459259235Z level=info msg="Migration successfully executed" id="Add column plugin_version to plugin_settings" duration=2.174944ms 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.499037117Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.499075861Z level=info msg="Migration successfully executed" id="Update plugin_setting table charset" duration=45.029µs 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.541136054Z level=info msg="Executing migration" id="create session table" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.541938206Z level=info msg="Migration successfully executed" id="create session table" duration=802.314µs 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.566271473Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.566385637Z level=info msg="Migration successfully executed" id="Drop old table playlist table" duration=127.161µs 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.591796515Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.591873476Z level=info msg="Migration successfully executed" id="Drop old table playlist_item table" duration=84.387µs 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.617061381Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-06T15:14:40.770 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.617734233Z level=info msg="Migration successfully executed" id="create playlist table v2" duration=672.376µs 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.642324129Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.642930647Z level=info msg="Migration successfully executed" id="create playlist item table v2" duration=605.818µs 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.667481042Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.667532279Z level=info msg="Migration successfully executed" id="Update playlist table charset" duration=42.418µs 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.692947758Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-06T15:14:40.771 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.693040531Z level=info msg="Migration successfully executed" id="Update playlist_item table charset" duration=94.505µs 2024-09-06T15:14:40.970 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:40.970 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.970 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.970 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.970 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.971 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[24979]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.734874503Z level=info msg="Executing migration" id="Add playlist column created_at" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.740570717Z level=info msg="Migration successfully executed" id="Add playlist column created_at" duration=5.696454ms 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.760231262Z level=info msg="Executing migration" id="Add playlist column updated_at" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.766156368Z level=info msg="Migration successfully executed" id="Add playlist column updated_at" duration=5.924969ms 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.785833866Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.786029988Z level=info msg="Migration successfully executed" id="drop preferences table v2" duration=195.968µs 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.827527276Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.827787984Z level=info msg="Migration successfully executed" id="drop preferences table v3" duration=259.057µs 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.861199709Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.862912885Z level=info msg="Migration successfully executed" id="create preferences table v3" duration=1.717586ms 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.87812375Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.87817709Z level=info msg="Migration successfully executed" id="Update preferences table charset" duration=54.056µs 2024-09-06T15:14:40.972 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.895058339Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.901436599Z level=info msg="Migration successfully executed" id="Add column team_id in preferences" duration=6.377554ms 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.92028508Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.920667302Z level=info msg="Migration successfully executed" id="Update team_id column values in preferences" duration=382.04µs 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.937151205Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.94285394Z level=info msg="Migration successfully executed" id="Add column week_start in preferences" duration=5.701865ms 2024-09-06T15:14:40.973 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.979092707Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-06T15:14:41.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:41.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:41.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:41.100 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[22757]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:39.712990+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:39.718068+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: cluster 2024-09-06T15:14:39.808307+0000 mgr.y (mgr.14631) 57 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.501790+0000 mon.a (mon.0) 835 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.516843+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:41.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.519873+0000 mon.c (mon.2) 62 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:41.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:41.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.521140+0000 mon.c (mon.2) 63 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:41.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.105 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:40 smithi189 bash[29727]: audit 2024-09-06T15:14:40.528486+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:41.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:40 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:40.9855899Z level=info msg="Migration successfully executed" id="Add column preferences.json_data" duration=6.496344ms 2024-09-06T15:14:41.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.012730915Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.012873238Z level=info msg="Migration successfully executed" id="alter preferences.json_data to mediumtext v1" duration=145.202µs 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.037994679Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.039843418Z level=info msg="Migration successfully executed" id="Add preferences index org_id" duration=1.848458ms 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.079974624Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.081731417Z level=info msg="Migration successfully executed" id="Add preferences index user_id" duration=1.757716ms 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.122151363Z level=info msg="Executing migration" id="create alert table v1" 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.124693309Z level=info msg="Migration successfully executed" id="create alert table v1" duration=2.543033ms 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.164122951Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.166094095Z level=info msg="Migration successfully executed" id="add index alert org_id & id " duration=1.971901ms 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.206039506Z level=info msg="Executing migration" id="add index alert state" 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.207808322Z level=info msg="Migration successfully executed" id="add index alert state" duration=1.768806ms 2024-09-06T15:14:41.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.231306843Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-06T15:14:41.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/3581248218 >> v1:172.21.15.189:6789/0 conn(0x7f03441017d0 legacy=0x7f0344101bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/3581248218 shutdown_connections 2024-09-06T15:14:41.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/3581248218 >> 172.21.15.189:0/3581248218 conn(0x7f03440fd240 msgr2=0x7f03440ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:41.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/3581248218 shutdown_connections 2024-09-06T15:14:41.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/3581248218 wait complete. 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 Processor -- start 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- start start 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f03441a75d0 con 0x7f034410a340 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f03441a87d0 con 0x7f03441017d0 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f03441a99d0 con 0x7f034410dee0 2024-09-06T15:14:41.314 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f0349b7c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f034410a340 0x7f03441a2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51480/0 (socket says 172.21.15.189:51480) 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f0349b7c640 1 -- 172.21.15.189:0/987939124 learned_addr learned my addr 172.21.15.189:0/987939124 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124107811 0 0) 0x7f03441a99d0 con 0x7f034410dee0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0330003240 con 0x7f034410dee0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501786224 0 0) 0x7f03441a75d0 con 0x7f034410a340 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03441a99d0 con 0x7f034410a340 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 454688253 0 0) 0x7f0330003240 con 0x7f034410dee0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03441a75d0 con 0x7f034410dee0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f033c001580 con 0x7f034410dee0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1314781770 0 0) 0x7f03441a99d0 con 0x7f034410a340 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0330003240 con 0x7f034410a340 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f03340018b0 con 0x7f034410a340 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1160863651 0 0) 0x7f03441a87d0 con 0x7f03441017d0 2024-09-06T15:14:41.315 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03441a99d0 con 0x7f03441017d0 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 767903865 0 0) 0x7f03441a75d0 con 0x7f034410dee0 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 >> v1:172.21.15.190:6789/0 conn(0x7f03441017d0 legacy=0x7f034410d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 >> v1:172.21.15.189:6789/0 conn(0x7f034410a340 legacy=0x7f03441a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03441aac70 con 0x7f034410dee0 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03441a7800 con 0x7f034410dee0 2024-09-06T15:14:41.316 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f03441a7e30 con 0x7f034410dee0 2024-09-06T15:14:41.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f033c003de0 con 0x7f034410dee0 2024-09-06T15:14:41.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f033c004cd0 con 0x7f034410dee0 2024-09-06T15:14:41.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.318+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0328000f80 con 0x7f034410dee0 2024-09-06T15:14:41.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.322+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f033c003970 con 0x7f034410dee0 2024-09-06T15:14:41.317 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.322+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f033c093e00 con 0x7f034410dee0 2024-09-06T15:14:41.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.322+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.190:6800/2144496764 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f033c0044a0 con 0x7f0330082ad0 2024-09-06T15:14:41.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.322+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7f033c094190 con 0x7f034410dee0 2024-09-06T15:14:41.318 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.322+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== osd.4 v1:172.21.15.190:6800/2144496764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f033c0044a0 con 0x7f0330082ad0 2024-09-06T15:14:41.332 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 --> v1:172.21.15.190:6800/2144496764 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0328002c70 con 0x7f0330082ad0 2024-09-06T15:14:41.333 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f033b7fe640 1 -- 172.21.15.189:0/987939124 <== osd.4 v1:172.21.15.190:6800/2144496764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 3539640957) 0x7f0328002c70 con 0x7f0330082ad0 2024-09-06T15:14:41.333 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 >> v1:172.21.15.190:6800/2144496764 conn(0x7f0330082ad0 legacy=0x7f0330084f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 >> v1:172.21.15.189:6800/1420554776 conn(0x7f03300784c0 legacy=0x7f033007a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 >> v1:172.21.15.189:6790/0 conn(0x7f034410dee0 legacy=0x7f03441a5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034ab7e640 1 -- 172.21.15.189:0/987939124 reap_dead start 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 shutdown_connections 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 >> 172.21.15.189:0/987939124 conn(0x7f03440fd240 msgr2=0x7f034406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:41.334 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 shutdown_connections 2024-09-06T15:14:41.335 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:41.338+0000 7f034c5e1640 1 -- 172.21.15.189:0/987939124 wait complete. 2024-09-06T15:14:41.499 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.233208465Z level=info msg="Migration successfully executed" id="add index alert dashboard_id" duration=1.900892ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.256496428Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.257948323Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v1" duration=1.450929ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.315149866Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.316878073Z level=info msg="Migration successfully executed" id="Add unique index alert_rule_tag.alert_id_tag_id" duration=1.727073ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.357068351Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.359347116Z level=info msg="Migration successfully executed" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" duration=2.248631ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.382383902Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.399449065Z level=info msg="Migration successfully executed" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" duration=17.067607ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.424396042Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.425933404Z level=info msg="Migration successfully executed" id="Create alert_rule_tag table v2" duration=1.536585ms 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.466218615Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-06T15:14:41.500 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.467976135Z level=info msg="Migration successfully executed" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" duration=1.75283ms 2024-09-06T15:14:41.501 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.508310064Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-06T15:14:41.751 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:41.752 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:41.752 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:41.752 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:41.752 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:41.752 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[24979]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:41.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.50905478Z level=info msg="Migration successfully executed" id="copy alert_rule_tag v1 to v2" duration=744.239µs 2024-09-06T15:14:41.752 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.533817416Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.534993968Z level=info msg="Migration successfully executed" id="drop table alert_rule_tag_v1" duration=1.178019ms 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.559081233Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.560678948Z level=info msg="Migration successfully executed" id="create alert_notification table v1" duration=1.598481ms 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.584285918Z level=info msg="Executing migration" id="Add column is_default" 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.590722872Z level=info msg="Migration successfully executed" id="Add column is_default" duration=6.436457ms 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.617830954Z level=info msg="Executing migration" id="Add column frequency" 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.624326215Z level=info msg="Migration successfully executed" id="Add column frequency" duration=6.495354ms 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.651439014Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.658714022Z level=info msg="Migration successfully executed" id="Add column send_reminder" duration=7.275263ms 2024-09-06T15:14:41.753 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.68502442Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-06T15:14:41.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.691600649Z level=info msg="Migration successfully executed" id="Add column disable_resolve_message" duration=6.573799ms 2024-09-06T15:14:41.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.718461321Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-06T15:14:41.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.720164134Z level=info msg="Migration successfully executed" id="add index alert_notification org_id & name" duration=1.70252ms 2024-09-06T15:14:41.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.760670816Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-06T15:14:41.754 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.760726123Z level=info msg="Migration successfully executed" id="Update alert table charset" duration=58.413µs 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.802537638Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.8026472Z level=info msg="Migration successfully executed" id="Update alert_notification table charset" duration=111.816µs 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.844545969Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.846159317Z level=info msg="Migration successfully executed" id="create notification_journal table v1" duration=1.612824ms 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.869808063Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-06T15:14:42.029 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.871579373Z level=info msg="Migration successfully executed" id="add index notification_journal org_id & alert_id & notifier_id" duration=1.770576ms 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.895086687Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.896938572Z level=info msg="Migration successfully executed" id="drop alert_notification_journal" duration=1.846995ms 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.920365497Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.92214858Z level=info msg="Migration successfully executed" id="create alert_notification_state table v1" duration=1.782662ms 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.945610242Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.94738291Z level=info msg="Migration successfully executed" id="add index alert_notification_state org_id & alert_id & notifier_id" duration=1.771719ms 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.98751294Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:41 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:41.994387406Z level=info msg="Migration successfully executed" id="Add for to alert table" duration=6.876696ms 2024-09-06T15:14:42.030 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.037759984Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-06T15:14:42.073 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[29727]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: cephadm 2024-09-06T15:14:40.564968+0000 mgr.y (mgr.14631) 58 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:42.074 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: cephadm 2024-09-06T15:14:40.568716+0000 mgr.y (mgr.14631) 59 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi189 2024-09-06T15:14:42.075 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:42.075 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:41 smithi189 bash[22757]: audit 2024-09-06T15:14:40.827430+0000 mgr.y (mgr.14631) 60 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:42.297 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.044798579Z level=info msg="Migration successfully executed" id="Add column uid in alert_notification" duration=7.037709ms 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.113163306Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.113638488Z level=info msg="Migration successfully executed" id="Update uid column values in alert_notification" duration=471.605µs 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.138538286Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.140303715Z level=info msg="Migration successfully executed" id="Add unique index alert_notification_org_id_uid" duration=1.764905ms 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.163780003Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.165463047Z level=info msg="Migration successfully executed" id="Remove unique index org_id_name" duration=1.681997ms 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.189002575Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.195789115Z level=info msg="Migration successfully executed" id="Add column secure_settings in alert_notification" duration=6.785546ms 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.222543297Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.222703833Z level=info msg="Migration successfully executed" id="alter alert.settings to mediumtext" duration=147.429µs 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.26444633Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-06T15:14:42.298 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.266133833Z level=info msg="Migration successfully executed" id="Add non-unique index alert_notification_state_alert_id" duration=1.687457ms 2024-09-06T15:14:42.299 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.306515527Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-06T15:14:42.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- 172.21.15.189:0/411227153 >> v1:172.21.15.189:6789/0 conn(0x7fe228101e40 legacy=0x7fe22810f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- 172.21.15.189:0/411227153 shutdown_connections 2024-09-06T15:14:42.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- 172.21.15.189:0/411227153 >> 172.21.15.189:0/411227153 conn(0x7fe2280fd260 msgr2=0x7fe2280ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:42.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- 172.21.15.189:0/411227153 shutdown_connections 2024-09-06T15:14:42.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- 172.21.15.189:0/411227153 wait complete. 2024-09-06T15:14:42.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 Processor -- start 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- start start 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2281a97f0 con 0x7fe228101e40 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2281aa9f0 con 0x7fe228101350 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22f516640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2281abbf0 con 0x7fe228111210 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22cab1640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe228101e40 0x7fe2281a4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51500/0 (socket says 172.21.15.189:51500) 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe22cab1640 1 -- 172.21.15.189:0/2267910270 learned_addr learned my addr 172.21.15.189:0/2267910270 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061579244 0 0) 0x7fe2281abbf0 con 0x7fe228111210 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe214003520 con 0x7fe228111210 2024-09-06T15:14:42.480 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032251780 0 0) 0x7fe2281a97f0 con 0x7fe228101e40 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2281abbf0 con 0x7fe228101e40 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3888113271 0 0) 0x7fe214003520 con 0x7fe228111210 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2281a97f0 con 0x7fe228111210 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083659030 0 0) 0x7fe2281aa9f0 con 0x7fe228101350 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe214003520 con 0x7fe228101350 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1457683800 0 0) 0x7fe2281abbf0 con 0x7fe228101e40 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2281aa9f0 con 0x7fe228101e40 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe220001580 con 0x7fe228111210 2024-09-06T15:14:42.481 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe224001650 con 0x7fe228101e40 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 842484853 0 0) 0x7fe2281a97f0 con 0x7fe228111210 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 >> v1:172.21.15.190:6789/0 conn(0x7fe228101350 legacy=0x7fe228110960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 >> v1:172.21.15.189:6789/0 conn(0x7fe228101e40 legacy=0x7fe2281a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.482+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2281ace90 con 0x7fe228111210 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2281abe20 con 0x7fe228111210 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2281ac380 con 0x7fe228111210 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe220003de0 con 0x7fe228111210 2024-09-06T15:14:42.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe220004c40 con 0x7fe228111210 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe20c000fb0 con 0x7fe228111210 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe220003f90 con 0x7fe228111210 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe220093dc0 con 0x7fe228111210 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6801/775653131 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe214086670 con 0x7fe2140829a0 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7fe220094150 con 0x7fe228111210 2024-09-06T15:14:42.483 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.486+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== osd.0 v1:172.21.15.189:6801/775653131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe214086670 con 0x7fe2140829a0 2024-09-06T15:14:42.497 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 --> v1:172.21.15.189:6801/775653131 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe20c002ca0 con 0x7fe2140829a0 2024-09-06T15:14:42.497 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe21e7fc640 1 -- 172.21.15.189:0/2267910270 <== osd.0 v1:172.21.15.189:6801/775653131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 523570214) 0x7fe20c002ca0 con 0x7fe2140829a0 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 >> v1:172.21.15.189:6801/775653131 conn(0x7fe2140829a0 legacy=0x7fe214084e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe214078410 legacy=0x7fe21407a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 >> v1:172.21.15.189:6790/0 conn(0x7fe228111210 legacy=0x7fe2281a7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22dab3640 1 -- 172.21.15.189:0/2267910270 reap_dead start 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 shutdown_connections 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 >> 172.21.15.189:0/2267910270 conn(0x7fe2280fd260 msgr2=0x7fe2280ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 shutdown_connections 2024-09-06T15:14:42.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:42.502+0000 7fe22f516640 1 -- 172.21.15.189:0/2267910270 wait complete. 2024-09-06T15:14:42.551 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.308433668Z level=info msg="Migration successfully executed" id="Add non-unique index alert_rule_tag_alert_id" duration=1.917242ms 2024-09-06T15:14:42.551 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.331835251Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-06T15:14:42.551 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.332039242Z level=info msg="Migration successfully executed" id="Drop old annotation table v4" duration=204.648µs 2024-09-06T15:14:42.551 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.356971469Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-06T15:14:42.551 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.358825704Z level=info msg="Migration successfully executed" id="create annotation table v5" duration=1.853635ms 2024-09-06T15:14:42.552 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.398988666Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-06T15:14:42.552 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.400666653Z level=info msg="Migration successfully executed" id="add index annotation 0 v3" duration=1.677504ms 2024-09-06T15:14:42.552 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.440946524Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-06T15:14:42.552 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.442609715Z level=info msg="Migration successfully executed" id="add index annotation 1 v3" duration=1.662768ms 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.466157589Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.467889025Z level=info msg="Migration successfully executed" id="add index annotation 2 v3" duration=1.730749ms 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.508172273Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.510138324Z level=info msg="Migration successfully executed" id="add index annotation 3 v3" duration=1.963601ms 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.533463697Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.535550363Z level=info msg="Migration successfully executed" id="add index annotation 4 v3" duration=2.08749ms 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.558938825Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-06T15:14:42.553 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.559000791Z level=info msg="Migration successfully executed" id="Update annotation table charset" duration=65.92µs 2024-09-06T15:14:42.810 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[24979]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:42.810 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[24979]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:42.810 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.584114674Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.591254247Z level=info msg="Migration successfully executed" id="Add column region_id to annotation table" duration=7.13873ms 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.617756862Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.619444203Z level=info msg="Migration successfully executed" id="Drop category_id index" duration=1.68659ms 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.642912181Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.650057698Z level=info msg="Migration successfully executed" id="Add column tags to annotation table" duration=7.144551ms 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.67652383Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.67790682Z level=info msg="Migration successfully executed" id="Create annotation_tag table v2" duration=1.382987ms 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.701756182Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.703700799Z level=info msg="Migration successfully executed" id="Add unique index annotation_tag.annotation_id_tag_id" duration=1.942544ms 2024-09-06T15:14:42.811 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.727078641Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-06T15:14:42.812 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.72896766Z level=info msg="Migration successfully executed" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" duration=1.887978ms 2024-09-06T15:14:42.812 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.760793557Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-06T15:14:42.812 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.781577921Z level=info msg="Migration successfully executed" id="Rename table annotation_tag to annotation_tag_v2 - v2" duration=20.782891ms 2024-09-06T15:14:42.812 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.819414422Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-06T15:14:43.062 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.821078519Z level=info msg="Migration successfully executed" id="Create annotation_tag table v3" duration=1.663197ms 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.844712479Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.846527278Z level=info msg="Migration successfully executed" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" duration=1.814198ms 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.86997723Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.870684953Z level=info msg="Migration successfully executed" id="copy annotation_tag v2 to v3" duration=707.103µs 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.911889472Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.913045407Z level=info msg="Migration successfully executed" id="drop table annotation_tag_v2" duration=1.154269ms 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.953902019Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.954357335Z level=info msg="Migration successfully executed" id="Update alert annotations and set TEXT to empty" duration=455.426µs 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.97912752Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:42 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:42.986439732Z level=info msg="Migration successfully executed" id="Add created time to annotation table" duration=7.312685ms 2024-09-06T15:14:43.063 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.012730036Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-06T15:14:43.064 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.019991512Z level=info msg="Migration successfully executed" id="Add updated time to annotation table" duration=7.260103ms 2024-09-06T15:14:43.064 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.046238764Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-06T15:14:43.064 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.048024993Z level=info msg="Migration successfully executed" id="Add index for created in annotation table" duration=1.783819ms 2024-09-06T15:14:43.064 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.071548628Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-06T15:14:43.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:42 smithi189 bash[29727]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:43.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:42 smithi189 bash[29727]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:43.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:42 smithi189 bash[22757]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:43.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:42 smithi189 bash[22757]: cluster 2024-09-06T15:14:41.809878+0000 mgr.y (mgr.14631) 61 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:43.332 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.073394966Z level=info msg="Migration successfully executed" id="Add index for updated in annotation table" duration=1.846902ms 2024-09-06T15:14:43.332 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.096827068Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-06T15:14:43.332 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.097323183Z level=info msg="Migration successfully executed" id="Convert existing annotations from seconds to milliseconds" duration=495.882µs 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.138727137Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.146528288Z level=info msg="Migration successfully executed" id="Add epoch_end column" duration=7.802104ms 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.172399822Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.174240961Z level=info msg="Migration successfully executed" id="Add index for epoch_end" duration=1.840055ms 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.197875231Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.19831887Z level=info msg="Migration successfully executed" id="Make epoch_end the same as epoch" duration=445.866µs 2024-09-06T15:14:43.333 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.222938074Z level=info msg="Executing migration" id="Move region to single row" 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.223638803Z level=info msg="Migration successfully executed" id="Move region to single row" duration=697.313µs 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.248135952Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.249865762Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch from annotation table" duration=1.72881ms 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.29009338Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.29175391Z level=info msg="Migration successfully executed" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" duration=1.659587ms 2024-09-06T15:14:43.334 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.315447053Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-06T15:14:43.335 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.31721452Z level=info msg="Migration successfully executed" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" duration=1.768693ms 2024-09-06T15:14:43.335 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.340632335Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-06T15:14:43.584 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.34258344Z level=info msg="Migration successfully executed" id="Add index for org_id_epoch_end_epoch on annotation table" duration=1.950291ms 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.3908335Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.392580656Z level=info msg="Migration successfully executed" id="Remove index org_id_epoch_epoch_end from annotation table" duration=1.748009ms 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.416196623Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.417978539Z level=info msg="Migration successfully executed" id="Add index for alert_id on annotation table" duration=1.781236ms 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.441456277Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.441667425Z level=info msg="Migration successfully executed" id="Increase tags column to length 4096" duration=213.485µs 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.466762337Z level=info msg="Executing migration" id="create test_data table" 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.468463994Z level=info msg="Migration successfully executed" id="create test_data table" duration=1.70111ms 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.508667936Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.510438776Z level=info msg="Migration successfully executed" id="create dashboard_version table v1" duration=1.770036ms 2024-09-06T15:14:43.585 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.54247508Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-06T15:14:43.586 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.544293159Z level=info msg="Migration successfully executed" id="add index dashboard_version.dashboard_id" duration=1.817379ms 2024-09-06T15:14:43.586 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.567726288Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-06T15:14:43.586 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.569571946Z level=info msg="Migration successfully executed" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" duration=1.843718ms 2024-09-06T15:14:43.586 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.592971628Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.593920403Z level=info msg="Migration successfully executed" id="Set dashboard version to 1 where 0" duration=943.741µs 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.61815901Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.618969326Z level=info msg="Migration successfully executed" id="save existing dashboard data in dashboard_version table v1" duration=810.306µs 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.643511383Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.643667012Z level=info msg="Migration successfully executed" id="alter dashboard_version.data to mediumtext v1" duration=156.642µs 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.668749848Z level=info msg="Executing migration" id="create team table" 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.670284573Z level=info msg="Migration successfully executed" id="create team table" duration=1.533972ms 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.694026982Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-06T15:14:43.854 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.696144895Z level=info msg="Migration successfully executed" id="add index team.org_id" duration=2.119509ms 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.71922098Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.721063411Z level=info msg="Migration successfully executed" id="add unique index team_org_id_name" duration=1.841709ms 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.744529377Z level=info msg="Executing migration" id="Add column uid in team" 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.752549479Z level=info msg="Migration successfully executed" id="Add column uid in team" duration=8.020712ms 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.794744102Z level=info msg="Executing migration" id="Update uid column values in team" 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.795176524Z level=info msg="Migration successfully executed" id="Update uid column values in team" duration=432.686µs 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.836782326Z level=info msg="Executing migration" id="Add unique index team_org_id_uid" 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.838843935Z level=info msg="Migration successfully executed" id="Add unique index team_org_id_uid" duration=2.058143ms 2024-09-06T15:14:43.855 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.862178448Z level=info msg="Executing migration" id="create team member table" 2024-09-06T15:14:44.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.070+0000 7f5e5e328640 1 -- 172.21.15.189:0/3226021145 >> v1:172.21.15.189:6789/0 conn(0x7f5e581017c0 legacy=0x7f5e58101ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/3226021145 shutdown_connections 2024-09-06T15:14:44.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/3226021145 >> 172.21.15.189:0/3226021145 conn(0x7f5e580fd210 msgr2=0x7f5e580ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/3226021145 shutdown_connections 2024-09-06T15:14:44.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/3226021145 wait complete. 2024-09-06T15:14:44.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 Processor -- start 2024-09-06T15:14:44.072 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- start start 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e581a97b0 con 0x7f5e5810ded0 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e581aa9b0 con 0x7f5e581017c0 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e581abbb0 con 0x7f5e5810a330 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5c8c5640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5e5810ded0 0x7f5e581a7eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51516/0 (socket says 172.21.15.189:51516) 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5c8c5640 1 -- 172.21.15.189:0/1258489520 learned_addr learned my addr 172.21.15.189:0/1258489520 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e577fe640 1 --1- 172.21.15.189:0/1258489520 >> v1:172.21.15.189:6790/0 conn(0x7f5e5810a330 0x7f5e581a4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:55092/0 (socket says 172.21.15.189:55092) 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773973902 0 0) 0x7f5e581abbb0 con 0x7f5e5810a330 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e40003160 con 0x7f5e5810a330 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989876154 0 0) 0x7f5e581a97b0 con 0x7f5e5810ded0 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e581abbb0 con 0x7f5e5810ded0 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2684633396 0 0) 0x7f5e40003160 con 0x7f5e5810a330 2024-09-06T15:14:44.073 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e581a97b0 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2313801231 0 0) 0x7f5e581abbb0 con 0x7f5e5810ded0 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e40003160 con 0x7f5e5810ded0 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579893461 0 0) 0x7f5e581aa9b0 con 0x7f5e581017c0 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e581abbb0 con 0x7f5e581017c0 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e4c001970 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e50001790 con 0x7f5e5810ded0 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 924888931 0 0) 0x7f5e581a97b0 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 >> v1:172.21.15.190:6789/0 conn(0x7f5e581017c0 legacy=0x7f5e580fef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 >> v1:172.21.15.189:6789/0 conn(0x7f5e5810ded0 legacy=0x7f5e581a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e581ace50 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e581a99e0 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e581aa010 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5e4c001cb0 con 0x7f5e5810a330 2024-09-06T15:14:44.074 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e4c005be0 con 0x7f5e5810a330 2024-09-06T15:14:44.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5e44000fb0 con 0x7f5e5810a330 2024-09-06T15:14:44.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.074+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f5e4c0038c0 con 0x7f5e5810a330 2024-09-06T15:14:44.075 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.078+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f5e4c094d50 con 0x7f5e5810a330 2024-09-06T15:14:44.076 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.078+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6805/2081655191 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e400867c0 con 0x7f5e40082af0 2024-09-06T15:14:44.076 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.078+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7f5e4c0950e0 con 0x7f5e5810a330 2024-09-06T15:14:44.076 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.078+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== osd.1 v1:172.21.15.189:6805/2081655191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f5e400867c0 con 0x7f5e40082af0 2024-09-06T15:14:44.090 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.094+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 --> v1:172.21.15.189:6805/2081655191 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e44002ca0 con 0x7f5e40082af0 2024-09-06T15:14:44.091 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.094+0000 7f5e557fa640 1 -- 172.21.15.189:0/1258489520 <== osd.1 v1:172.21.15.189:6805/2081655191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1833485940) 0x7f5e44002ca0 con 0x7f5e40082af0 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 >> v1:172.21.15.189:6805/2081655191 conn(0x7f5e40082af0 legacy=0x7f5e40084f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 >> v1:172.21.15.189:6800/1420554776 conn(0x7f5e400784e0 legacy=0x7f5e4007a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 >> v1:172.21.15.189:6790/0 conn(0x7f5e5810a330 legacy=0x7f5e581a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5c8c5640 1 -- 172.21.15.189:0/1258489520 reap_dead start 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 shutdown_connections 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 >> 172.21.15.189:0/1258489520 conn(0x7f5e580fd210 msgr2=0x7f5e581047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 shutdown_connections 2024-09-06T15:14:44.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.098+0000 7f5e5e328640 1 -- 172.21.15.189:0/1258489520 wait complete. 2024-09-06T15:14:44.113 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[24979]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.114 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[24979]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.114 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.864104636Z level=info msg="Migration successfully executed" id="create team member table" duration=1.925821ms 2024-09-06T15:14:44.114 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.904136467Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-06T15:14:44.114 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.906048715Z level=info msg="Migration successfully executed" id="add index team_member.org_id" duration=1.912375ms 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.929414814Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.931393841Z level=info msg="Migration successfully executed" id="add unique index team_member_org_id_team_id_user_id" duration=1.979824ms 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.979745021Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:43 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:43.981578553Z level=info msg="Migration successfully executed" id="add index team_member.team_id" duration=1.832392ms 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.005060667Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.013452762Z level=info msg="Migration successfully executed" id="Add column email to team table" duration=8.393691ms 2024-09-06T15:14:44.115 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.063575565Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-06T15:14:44.116 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.072080949Z level=info msg="Migration successfully executed" id="Add column external to team_member table" duration=8.504787ms 2024-09-06T15:14:44.116 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.122277161Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-06T15:14:44.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.206+0000 7f6b48335640 1 -- 172.21.15.189:0/682541848 >> v1:172.21.15.189:6790/0 conn(0x7f6b4010efe0 legacy=0x7f6b401114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.206+0000 7f6b48335640 1 -- 172.21.15.189:0/682541848 shutdown_connections 2024-09-06T15:14:44.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.206+0000 7f6b48335640 1 -- 172.21.15.189:0/682541848 >> 172.21.15.189:0/682541848 conn(0x7f6b400fe360 msgr2=0x7f6b40100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.206+0000 7f6b48335640 1 -- 172.21.15.189:0/682541848 shutdown_connections 2024-09-06T15:14:44.203 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.206+0000 7f6b48335640 1 -- 172.21.15.189:0/682541848 wait complete. 2024-09-06T15:14:44.204 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 Processor -- start 2024-09-06T15:14:44.204 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- start start 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6b401a9730 con 0x7f6b4010b440 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6b401aa930 con 0x7f6b4010efe0 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f6b401abb30 con 0x7f6b401028d0 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b460d1640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f6b401028d0 0x7f6b401112f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:55118/0 (socket says 172.21.15.189:55118) 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b458d0640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f6b4010b440 0x7f6b401a4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51538/0 (socket says 172.21.15.189:51538) 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b460d1640 1 -- 172.21.15.189:0/3512324541 learned_addr learned my addr 172.21.15.189:0/3512324541 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 653478083 0 0) 0x7f6b401a9730 con 0x7f6b4010b440 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b2c003160 con 0x7f6b4010b440 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405516602 0 0) 0x7f6b401abb30 con 0x7f6b401028d0 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b401a9730 con 0x7f6b401028d0 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2721940264 0 0) 0x7f6b2c003160 con 0x7f6b4010b440 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b401abb30 con 0x7f6b4010b440 2024-09-06T15:14:44.205 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6b34001410 con 0x7f6b4010b440 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 979850079 0 0) 0x7f6b401a9730 con 0x7f6b401028d0 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b2c003160 con 0x7f6b401028d0 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6b3c001970 con 0x7f6b401028d0 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98090450 0 0) 0x7f6b401aa930 con 0x7f6b4010efe0 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b401a9730 con 0x7f6b4010efe0 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3934999494 0 0) 0x7f6b401abb30 con 0x7f6b4010b440 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 >> v1:172.21.15.189:6790/0 conn(0x7f6b401028d0 legacy=0x7f6b401112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 >> v1:172.21.15.190:6789/0 conn(0x7f6b4010efe0 legacy=0x7f6b401a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b401acdd0 con 0x7f6b4010b440 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b401abd60 con 0x7f6b4010b440 2024-09-06T15:14:44.206 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b401ac2c0 con 0x7f6b4010b440 2024-09-06T15:14:44.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f6b34001630 con 0x7f6b4010b440 2024-09-06T15:14:44.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6b34005b60 con 0x7f6b4010b440 2024-09-06T15:14:44.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6b24000f80 con 0x7f6b4010b440 2024-09-06T15:14:44.207 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f6b340038a0 con 0x7f6b4010b440 2024-09-06T15:14:44.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.210+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f6b34094ba0 con 0x7f6b4010b440 2024-09-06T15:14:44.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.214+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6813/3926696354 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b2c0866c0 con 0x7f6b2c0829f0 2024-09-06T15:14:44.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.214+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7f6b34094f30 con 0x7f6b4010b440 2024-09-06T15:14:44.208 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.214+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== osd.3 v1:172.21.15.189:6813/3926696354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f6b2c0866c0 con 0x7f6b2c0829f0 2024-09-06T15:14:44.223 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 --> v1:172.21.15.189:6813/3926696354 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b24002c70 con 0x7f6b2c0829f0 2024-09-06T15:14:44.223 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b337fe640 1 -- 172.21.15.189:0/3512324541 <== osd.3 v1:172.21.15.189:6813/3926696354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 2671382780) 0x7f6b24002c70 con 0x7f6b2c0829f0 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 >> v1:172.21.15.189:6813/3926696354 conn(0x7f6b2c0829f0 legacy=0x7f6b2c084e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 >> v1:172.21.15.189:6800/1420554776 conn(0x7f6b2c0783e0 legacy=0x7f6b2c07a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 >> v1:172.21.15.189:6789/0 conn(0x7f6b4010b440 legacy=0x7f6b401a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b468d2640 1 -- 172.21.15.189:0/3512324541 reap_dead start 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 shutdown_connections 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.226+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 >> 172.21.15.189:0/3512324541 conn(0x7f6b400fe360 msgr2=0x7f6b401060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.230+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 shutdown_connections 2024-09-06T15:14:44.224 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.230+0000 7f6b48335640 1 -- 172.21.15.189:0/3512324541 wait complete. 2024-09-06T15:14:44.233 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:43 smithi189 bash[22757]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.233 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:43 smithi189 bash[22757]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.234 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:43 smithi189 bash[29727]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.234 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:43 smithi189 bash[29727]: cluster 2024-09-06T15:14:43.810753+0000 mgr.y (mgr.14631) 62 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:44.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.130696072Z level=info msg="Migration successfully executed" id="Add column permission to team_member table" duration=8.418291ms 2024-09-06T15:14:44.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.164305818Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-06T15:14:44.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.166256893Z level=info msg="Migration successfully executed" id="create dashboard acl table" duration=1.950401ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.197876995Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.199792923Z level=info msg="Migration successfully executed" id="add index dashboard_acl_dashboard_id" duration=1.917562ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.239776891Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.24188178Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_user_id" duration=2.104166ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.265080201Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.267024419Z level=info msg="Migration successfully executed" id="add unique index dashboard_acl_dashboard_id_team_id" duration=1.943372ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.30699788Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.308824162Z level=info msg="Migration successfully executed" id="add index dashboard_acl_user_id" duration=1.818702ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.348994058Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.350846987Z level=info msg="Migration successfully executed" id="add index dashboard_acl_team_id" duration=1.852439ms 2024-09-06T15:14:44.366 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.374257542Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-06T15:14:44.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/3291823831 >> v1:172.21.15.189:6790/0 conn(0x7fc37c1017f0 legacy=0x7fc37c101bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/3291823831 shutdown_connections 2024-09-06T15:14:44.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/3291823831 >> 172.21.15.189:0/3291823831 conn(0x7fc37c0fd220 msgr2=0x7fc37c0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/3291823831 shutdown_connections 2024-09-06T15:14:44.401 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/3291823831 wait complete. 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 Processor -- start 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- start start 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc37c1a7660 con 0x7fc37c1017f0 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc37c1a8860 con 0x7fc37c10a360 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc37c1a9a60 con 0x7fc37c10df00 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3823dd640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fc37c1017f0 0x7fc37c10d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51556/0 (socket says 172.21.15.189:51556) 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3823dd640 1 -- 172.21.15.189:0/1881175030 learned_addr learned my addr 172.21.15.189:0/1881175030 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121774230 0 0) 0x7fc37c1a9a60 con 0x7fc37c10df00 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003520 con 0x7fc37c10df00 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854955876 0 0) 0x7fc37c1a7660 con 0x7fc37c1017f0 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc37c1a9a60 con 0x7fc37c1017f0 2024-09-06T15:14:44.403 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3106018857 0 0) 0x7fc368003520 con 0x7fc37c10df00 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc37c1a7660 con 0x7fc37c10df00 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc374001bb0 con 0x7fc37c10df00 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564962540 0 0) 0x7fc37c1a8860 con 0x7fc37c10a360 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc368003520 con 0x7fc37c10a360 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1198361944 0 0) 0x7fc37c1a7660 con 0x7fc37c10df00 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 >> v1:172.21.15.190:6789/0 conn(0x7fc37c10a360 legacy=0x7fc37c1a2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 >> v1:172.21.15.189:6789/0 conn(0x7fc37c1017f0 legacy=0x7fc37c10d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c1aad00 con 0x7fc37c10df00 2024-09-06T15:14:44.404 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc384641640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c1a9c90 con 0x7fc37c10df00 2024-09-06T15:14:44.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fc374003de0 con 0x7fc37c10df00 2024-09-06T15:14:44.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.406+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc374004c90 con 0x7fc37c10df00 2024-09-06T15:14:44.405 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc384641640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc37c1aa2c0 con 0x7fc37c10df00 2024-09-06T15:14:44.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc364000f80 con 0x7fc37c10df00 2024-09-06T15:14:44.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fc374003970 con 0x7fc37c10df00 2024-09-06T15:14:44.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fc374092110 con 0x7fc37c10df00 2024-09-06T15:14:44.406 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.190:6804/1567707916 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc36808b620 con 0x7fc368087910 2024-09-06T15:14:44.407 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.410+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7fc374058bf0 con 0x7fc37c10df00 2024-09-06T15:14:44.409 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.414+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== osd.5 v1:172.21.15.190:6804/1567707916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc36808b620 con 0x7fc368087910 2024-09-06T15:14:44.422 INFO:teuthology.orchestra.run.smithi189.stdout:133143986239 2024-09-06T15:14:44.422 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-06T15:14:44.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 --> v1:172.21.15.190:6804/1567707916 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc364002c70 con 0x7fc368087910 2024-09-06T15:14:44.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3737fe640 1 -- 172.21.15.189:0/1881175030 <== osd.5 v1:172.21.15.190:6804/1567707916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 2218079740) 0x7fc364002c70 con 0x7fc368087910 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 >> v1:172.21.15.190:6804/1567707916 conn(0x7fc368087910 legacy=0x7fc368089db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 >> v1:172.21.15.189:6800/1420554776 conn(0x7fc36807c7d0 legacy=0x7fc36807ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 >> v1:172.21.15.189:6790/0 conn(0x7fc37c10df00 legacy=0x7fc37c1a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc382bde640 1 -- 172.21.15.189:0/1881175030 reap_dead start 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 shutdown_connections 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 >> 172.21.15.189:0/1881175030 conn(0x7fc37c0fd220 msgr2=0x7fc37c105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:44.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 shutdown_connections 2024-09-06T15:14:44.428 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:44.430+0000 7fc3717fa640 1 -- 172.21.15.189:0/1881175030 wait complete. 2024-09-06T15:14:44.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.37619173Z level=info msg="Migration successfully executed" id="add index dashboard_acl_org_id_role" duration=1.931621ms 2024-09-06T15:14:44.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.416256971Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-06T15:14:44.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.418263307Z level=info msg="Migration successfully executed" id="add index dashboard_permission" duration=2.00186ms 2024-09-06T15:14:44.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.458204302Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-06T15:14:44.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.459268268Z level=info msg="Migration successfully executed" id="save default acl rules in dashboard_acl table" duration=1.06372ms 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.500291483Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.500845707Z level=info msg="Migration successfully executed" id="delete acl rules for deleted dashboards and folders" duration=555.604µs 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.53404324Z level=info msg="Executing migration" id="create tag table" 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.535497106Z level=info msg="Migration successfully executed" id="create tag table" duration=1.452749ms 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.559374021Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-06T15:14:44.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.56118085Z level=info msg="Migration successfully executed" id="add index tag.key_value" duration=1.807366ms 2024-09-06T15:14:44.624 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.584647112Z level=info msg="Executing migration" id="create login attempt table" 2024-09-06T15:14:44.624 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.586170554Z level=info msg="Migration successfully executed" id="create login attempt table" duration=1.522702ms 2024-09-06T15:14:44.624 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.60984188Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-06T15:14:44.624 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.611666735Z level=info msg="Migration successfully executed" id="add index login_attempt.username" duration=1.824392ms 2024-09-06T15:14:44.953 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.651779235Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-06T15:14:44.953 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.653558068Z level=info msg="Migration successfully executed" id="drop index IDX_login_attempt_username - v1" duration=1.778216ms 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.676941834Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.70466802Z level=info msg="Migration successfully executed" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" duration=27.725253ms 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.743983875Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.745596066Z level=info msg="Migration successfully executed" id="create login_attempt v2" duration=1.611291ms 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.769288302Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.771308669Z level=info msg="Migration successfully executed" id="create index IDX_login_attempt_username - v2" duration=2.01971ms 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.81124264Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.81204057Z level=info msg="Migration successfully executed" id="copy login_attempt v1 to v2" duration=797.533µs 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.853242269Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.85472062Z level=info msg="Migration successfully executed" id="drop login_attempt_tmp_qwerty" duration=1.479785ms 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.878517739Z level=info msg="Executing migration" id="create user auth table" 2024-09-06T15:14:44.954 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.88020807Z level=info msg="Migration successfully executed" id="create user auth table" duration=1.689623ms 2024-09-06T15:14:44.955 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.962234081Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/3696423250 >> v1:172.21.15.189:6789/0 conn(0x7f1c2810b440 legacy=0x7f1c2810d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/3696423250 shutdown_connections 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/3696423250 >> 172.21.15.189:0/3696423250 conn(0x7f1c28078cc0 msgr2=0x7f1c280790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/3696423250 shutdown_connections 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/3696423250 wait complete. 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 Processor -- start 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- start start 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c2810e880 con 0x7f1c2810efe0 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c281aa9b0 con 0x7f1c28101220 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c281abb90 con 0x7f1c2810b440 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2e189640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1c2810efe0 0x7f1c281a8280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51574/0 (socket says 172.21.15.189:51574) 2024-09-06T15:14:45.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2e189640 1 -- 172.21.15.189:0/466226394 learned_addr learned my addr 172.21.15.189:0/466226394 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:45.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2d187640 1 --1- 172.21.15.189:0/466226394 >> v1:172.21.15.189:6790/0 conn(0x7f1c2810b440 0x7f1c281a4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:55138/0 (socket says 172.21.15.189:55138) 2024-09-06T15:14:45.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529194278 0 0) 0x7f1c281abb90 con 0x7f1c2810b440 2024-09-06T15:14:45.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c14003240 con 0x7f1c2810b440 2024-09-06T15:14:45.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939377248 0 0) 0x7f1c2810e880 con 0x7f1c2810efe0 2024-09-06T15:14:45.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c281abb90 con 0x7f1c2810efe0 2024-09-06T15:14:45.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1857479088 0 0) 0x7f1c14003240 con 0x7f1c2810b440 2024-09-06T15:14:45.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c2810e880 con 0x7f1c2810b440 2024-09-06T15:14:45.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4050685684 0 0) 0x7f1c281abb90 con 0x7f1c2810efe0 2024-09-06T15:14:45.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c14003240 con 0x7f1c2810efe0 2024-09-06T15:14:45.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c18001460 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c20001790 con 0x7f1c2810efe0 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901083445 0 0) 0x7f1c281aa9b0 con 0x7f1c28101220 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c281abb90 con 0x7f1c28101220 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1298666225 0 0) 0x7f1c2810e880 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 >> v1:172.21.15.190:6789/0 conn(0x7f1c28101220 legacy=0x7f1c2810dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 >> v1:172.21.15.189:6789/0 conn(0x7f1c2810efe0 legacy=0x7f1c281a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c281acdc0 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c281a9a00 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c281aa030 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1c18003a60 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.018+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c18004b50 con 0x7f1c2810b440 2024-09-06T15:14:45.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.022+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1c0c000fb0 con 0x7f1c2810b440 2024-09-06T15:14:45.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.022+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f1c18003d10 con 0x7f1c2810b440 2024-09-06T15:14:45.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.022+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f1c18094c90 con 0x7f1c2810b440 2024-09-06T15:14:45.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.022+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.190:6812/2054184397 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c14086690 con 0x7f1c140829c0 2024-09-06T15:14:45.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.022+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7f1c18095020 con 0x7f1c2810b440 2024-09-06T15:14:45.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.026+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== osd.7 v1:172.21.15.190:6812/2054184397 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f1c14086690 con 0x7f1c140829c0 2024-09-06T15:14:45.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 --> v1:172.21.15.190:6812/2054184397 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c0c002ca0 con 0x7f1c140829c0 2024-09-06T15:14:45.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c1effd640 1 -- 172.21.15.189:0/466226394 <== osd.7 v1:172.21.15.190:6812/2054184397 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 79331694) 0x7f1c0c002ca0 con 0x7f1c140829c0 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 >> v1:172.21.15.190:6812/2054184397 conn(0x7f1c140829c0 legacy=0x7f1c14084e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 >> v1:172.21.15.189:6800/1420554776 conn(0x7f1c14078430 legacy=0x7f1c1407a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 >> v1:172.21.15.189:6790/0 conn(0x7f1c2810b440 legacy=0x7f1c281a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2e189640 1 -- 172.21.15.189:0/466226394 reap_dead start 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 shutdown_connections 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 >> 172.21.15.189:0/466226394 conn(0x7f1c28078cc0 msgr2=0x7f1c28102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 shutdown_connections 2024-09-06T15:14:45.035 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.038+0000 7f1c2fbec640 1 -- 172.21.15.189:0/466226394 wait complete. 2024-09-06T15:14:45.155 INFO:teuthology.orchestra.run.smithi189.stdout:34359738474 2024-09-06T15:14:45.155 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:44 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:44.964318714Z level=info msg="Migration successfully executed" id="create index IDX_user_auth_auth_module_auth_id - v1" duration=2.083863ms 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.004365304Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.00450806Z level=info msg="Migration successfully executed" id="alter user_auth.auth_id to length 190" duration=145.832µs 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.046187824Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.055345375Z level=info msg="Migration successfully executed" id="Add OAuth access token to user_auth" duration=9.157514ms 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.096618244Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-06T15:14:45.222 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.105767984Z level=info msg="Migration successfully executed" id="Add OAuth refresh token to user_auth" duration=9.147627ms 2024-09-06T15:14:45.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.146894462Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-06T15:14:45.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.156533848Z level=info msg="Migration successfully executed" id="Add OAuth token type to user_auth" duration=9.638326ms 2024-09-06T15:14:45.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.197328788Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-06T15:14:45.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.208482059Z level=info msg="Migration successfully executed" id="Add OAuth expiry to user_auth" duration=11.151755ms 2024-09-06T15:14:45.223 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.230990184Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- 172.21.15.189:0/2700414563 >> v1:172.21.15.189:6789/0 conn(0x7f066410b640 legacy=0x7f066410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- 172.21.15.189:0/2700414563 shutdown_connections 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- 172.21.15.189:0/2700414563 >> 172.21.15.189:0/2700414563 conn(0x7f06640fd210 msgr2=0x7f06640ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- 172.21.15.189:0/2700414563 shutdown_connections 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- 172.21.15.189:0/2700414563 wait complete. 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 Processor -- start 2024-09-06T15:14:45.339 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- start start 2024-09-06T15:14:45.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f06641a9830 con 0x7f066410b640 2024-09-06T15:14:45.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f06641aaa30 con 0x7f066410f150 2024-09-06T15:14:45.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.342+0000 7f066977e640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f06641abc30 con 0x7f0664103660 2024-09-06T15:14:45.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f0662ffd640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f0664103660 0x7f0664102d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:55144/0 (socket says 172.21.15.189:55144) 2024-09-06T15:14:45.340 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f0662ffd640 1 -- 172.21.15.189:0/437857639 learned_addr learned my addr 172.21.15.189:0/437857639 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449296141 0 0) 0x7f06641a9830 con 0x7f066410b640 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f064c003520 con 0x7f066410b640 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016184786 0 0) 0x7f06641abc30 con 0x7f0664103660 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06641a9830 con 0x7f0664103660 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2271635558 0 0) 0x7f064c003520 con 0x7f066410b640 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06641abc30 con 0x7f066410b640 2024-09-06T15:14:45.341 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0654001430 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1190320225 0 0) 0x7f06641a9830 con 0x7f0664103660 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f064c003520 con 0x7f0664103660 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0658001930 con 0x7f0664103660 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062005520 0 0) 0x7f06641aaa30 con 0x7f066410f150 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06641a9830 con 0x7f066410f150 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1151905301 0 0) 0x7f06641abc30 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 >> v1:172.21.15.189:6790/0 conn(0x7f0664103660 legacy=0x7f0664102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 >> v1:172.21.15.190:6789/0 conn(0x7f066410f150 legacy=0x7f06641a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06641aced0 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06641abe60 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f06641ac410 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f06540035f0 con 0x7f066410b640 2024-09-06T15:14:45.342 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0654004a50 con 0x7f066410b640 2024-09-06T15:14:45.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0650000fb0 con 0x7f066410b640 2024-09-06T15:14:45.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f0654001940 con 0x7f066410b640 2024-09-06T15:14:45.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f06540939f0 con 0x7f066410b640 2024-09-06T15:14:45.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6809/2943648838 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0654003f20 con 0x7f064c082bd0 2024-09-06T15:14:45.343 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.346+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7f0654093d80 con 0x7f066410b640 2024-09-06T15:14:45.344 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.350+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== osd.2 v1:172.21.15.189:6809/2943648838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f0654003f20 con 0x7f064c082bd0 2024-09-06T15:14:45.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 --> v1:172.21.15.189:6809/2943648838 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0650002ca0 con 0x7f064c082bd0 2024-09-06T15:14:45.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f064bfff640 1 -- 172.21.15.189:0/437857639 <== osd.2 v1:172.21.15.189:6809/2943648838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1508659346) 0x7f0650002ca0 con 0x7f064c082bd0 2024-09-06T15:14:45.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 >> v1:172.21.15.189:6809/2943648838 conn(0x7f064c082bd0 legacy=0x7f064c085030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 >> v1:172.21.15.189:6800/1420554776 conn(0x7f064c078540 legacy=0x7f064c07aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 >> v1:172.21.15.189:6789/0 conn(0x7f066410b640 legacy=0x7f06641a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:45.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f06637fe640 1 -- 172.21.15.189:0/437857639 reap_dead start 2024-09-06T15:14:45.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 shutdown_connections 2024-09-06T15:14:45.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 >> 172.21.15.189:0/437857639 conn(0x7f06640fd210 msgr2=0x7f06640fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:45.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 shutdown_connections 2024-09-06T15:14:45.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:45.362+0000 7f066977e640 1 -- 172.21.15.189:0/437857639 wait complete. 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.232948618Z level=info msg="Migration successfully executed" id="Add index to user_id column in user_auth" duration=1.957801ms 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.272974675Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.282278925Z level=info msg="Migration successfully executed" id="Add OAuth ID token to user_auth" duration=9.303433ms 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.306566879Z level=info msg="Executing migration" id="create server_lock table" 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.308210549Z level=info msg="Migration successfully executed" id="create server_lock table" duration=1.642684ms 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.331919788Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-06T15:14:45.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.333782217Z level=info msg="Migration successfully executed" id="add index server_lock.operation_uid" duration=1.861455ms 2024-09-06T15:14:45.483 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.373914057Z level=info msg="Executing migration" id="create user auth token table" 2024-09-06T15:14:45.483 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.37570963Z level=info msg="Migration successfully executed" id="create user auth token table" duration=1.795256ms 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.490934251Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.492889953Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.auth_token" duration=1.955828ms 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.516281362Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.518226306Z level=info msg="Migration successfully executed" id="add unique index user_auth_token.prev_auth_token" duration=1.945564ms 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.541547933Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.54357836Z level=info msg="Migration successfully executed" id="add index user_auth_token.user_id" duration=2.029891ms 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.566790548Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.576628022Z level=info msg="Migration successfully executed" id="Add revoked_at to the user auth token" duration=9.836461ms 2024-09-06T15:14:45.735 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.600278752Z level=info msg="Executing migration" id="add index user_auth_token.revoked_at" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.602294696Z level=info msg="Migration successfully executed" id="add index user_auth_token.revoked_at" duration=2.018551ms 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.625593656Z level=info msg="Executing migration" id="create cache_data table" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.627461771Z level=info msg="Migration successfully executed" id="create cache_data table" duration=1.867059ms 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.651059051Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.652988456Z level=info msg="Migration successfully executed" id="add unique index cache_data.cache_key" duration=1.928488ms 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.676322693Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.678272877Z level=info msg="Migration successfully executed" id="create short_url table v1" duration=1.949148ms 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.718222678Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.720243861Z level=info msg="Migration successfully executed" id="add index short_url.org_id-uid" duration=2.02017ms 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.743490019Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-06T15:14:45.736 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.74368596Z level=info msg="Migration successfully executed" id="alter table short_url alter column created_by type to bigint" duration=194.261µs 2024-09-06T15:14:45.995 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[24979]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:45.995 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[24979]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:45.995 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.78556579Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-06T15:14:45.995 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.785808008Z level=info msg="Migration successfully executed" id="delete alert_definition table" duration=244.455µs 2024-09-06T15:14:45.995 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.827643057Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-06T15:14:45.995 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.829589282Z level=info msg="Migration successfully executed" id="recreate alert_definition table" duration=1.941771ms 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.852926128Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.854998831Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and title columns" duration=2.071846ms 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.895201454Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.897312859Z level=info msg="Migration successfully executed" id="add index in alert_definition on org_id and uid columns" duration=2.111886ms 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.9370035Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.937172842Z level=info msg="Migration successfully executed" id="alter alert_definition table data column to mediumtext in mysql" duration=169.198µs 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.978858043Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:45 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:45.980822237Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and title columns" duration=1.963904ms 2024-09-06T15:14:45.996 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.00416964Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.006204817Z level=info msg="Migration successfully executed" id="drop index in alert_definition on org_id and uid columns" duration=2.034467ms 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.029353916Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.031351593Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and title columns" duration=1.997047ms 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.071348907Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.073582212Z level=info msg="Migration successfully executed" id="add unique index in alert_definition on org_id and uid columns" duration=2.232298ms 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.096699204Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-06T15:14:46.256 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.107062317Z level=info msg="Migration successfully executed" id="Add column paused in alert_definition" duration=10.362153ms 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.130104603Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.132111676Z level=info msg="Migration successfully executed" id="drop alert_definition table" duration=2.006333ms 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.155504149Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.155705684Z level=info msg="Migration successfully executed" id="delete alert_definition_version table" duration=200.432µs 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.180728748Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.182744411Z level=info msg="Migration successfully executed" id="recreate alert_definition_version table" duration=2.0147ms 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.222738752Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.224764482Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_id and version columns" duration=2.024767ms 2024-09-06T15:14:46.257 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.264747854Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-06T15:14:46.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:45 smithi189 bash[22757]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:46.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:45 smithi189 bash[22757]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:46.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:45 smithi189 bash[29727]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:46.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:45 smithi189 bash[29727]: cluster 2024-09-06T15:14:45.812131+0000 mgr.y (mgr.14631) 63 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:46.420 INFO:teuthology.orchestra.run.smithi189.stdout:55834574943 2024-09-06T15:14:46.421 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.266929406Z level=info msg="Migration successfully executed" id="add index in alert_definition_version table on alert_definition_uid and version columns" duration=2.181219ms 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.298317668Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.298462886Z level=info msg="Migration successfully executed" id="alter alert_definition_version table data column to mediumtext in mysql" duration=140.522µs 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.348604601Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.350668181Z level=info msg="Migration successfully executed" id="drop alert_definition_version table" duration=2.06293ms 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.399021395Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.400969822Z level=info msg="Migration successfully executed" id="create alert_instance table" duration=1.947417ms 2024-09-06T15:14:46.508 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.432648852Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-06T15:14:46.509 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.434705999Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" duration=2.055756ms 2024-09-06T15:14:46.509 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.466115063Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-06T15:14:46.509 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.468137496Z level=info msg="Migration successfully executed" id="add index in alert_instance table on def_org_id, current_state columns" duration=2.021517ms 2024-09-06T15:14:46.510 INFO:teuthology.orchestra.run.smithi189.stdout:111669149768 2024-09-06T15:14:46.510 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-06T15:14:46.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/1211751516 >> v1:172.21.15.189:6790/0 conn(0x7fa2f810b440 legacy=0x7fa2f810d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/1211751516 shutdown_connections 2024-09-06T15:14:46.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/1211751516 >> 172.21.15.189:0/1211751516 conn(0x7fa2f8078d60 msgr2=0x7fa2f8079170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:46.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/1211751516 shutdown_connections 2024-09-06T15:14:46.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/1211751516 wait complete. 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 Processor -- start 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- start start 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2fc8f8640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fa2f8101220 0x7fa2f810ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:55170/0 (socket says 172.21.15.189:55170) 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f7fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa2f810b440 0x7fa2f81a2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:51626/0 (socket says 172.21.15.189:51626) 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2fc8f8640 1 -- 172.21.15.189:0/3755709165 learned_addr learned my addr 172.21.15.189:0/3755709165 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa2f81a76c0 con 0x7fa2f810b440 2024-09-06T15:14:46.606 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa2f81a7890 con 0x7fa2f810efe0 2024-09-06T15:14:46.607 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219320840 0 0) 0x7fa2f81a76c0 con 0x7fa2f810b440 2024-09-06T15:14:46.607 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2feb5c640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fa2f81a7a60 con 0x7fa2f8101220 2024-09-06T15:14:46.607 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e8003520 con 0x7fa2f810b440 2024-09-06T15:14:46.607 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504001492 0 0) 0x7fa2f81a7a60 con 0x7fa2f8101220 2024-09-06T15:14:46.607 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f81a76c0 con 0x7fa2f8101220 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604706299 0 0) 0x7fa2f81a7890 con 0x7fa2f810efe0 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f81a7a60 con 0x7fa2f810efe0 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3539938544 0 0) 0x7fa2f81a76c0 con 0x7fa2f8101220 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2f81a7890 con 0x7fa2f8101220 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1629013573 0 0) 0x7fa2e8003520 con 0x7fa2f810b440 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2f81a76c0 con 0x7fa2f810b440 2024-09-06T15:14:46.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.610+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fa2e4001af0 con 0x7fa2f810b440 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fa2ec0019f0 con 0x7fa2f8101220 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3644425930 0 0) 0x7fa2f81a76c0 con 0x7fa2f810b440 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 >> v1:172.21.15.189:6790/0 conn(0x7fa2f8101220 legacy=0x7fa2f810ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 >> v1:172.21.15.190:6789/0 conn(0x7fa2f810efe0 legacy=0x7fa2f81a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f81a7cf0 con 0x7fa2f810b440 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2feb5c640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f81a7fe0 con 0x7fa2f810b440 2024-09-06T15:14:46.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2feb5c640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2f81a85c0 con 0x7fa2f810b440 2024-09-06T15:14:46.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fa2e40045b0 con 0x7fa2f810b440 2024-09-06T15:14:46.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fa2e4004e30 con 0x7fa2f810b440 2024-09-06T15:14:46.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.189:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa2d8000f80 con 0x7fa2f810b440 2024-09-06T15:14:46.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fa2e4004e10 con 0x7fa2f810b440 2024-09-06T15:14:46.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fa2e40953e0 con 0x7fa2f810b440 2024-09-06T15:14:46.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.190:6808/507475988 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2e8086690 con 0x7fa2e80829c0 2024-09-06T15:14:46.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.614+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (unknown 3088285094 0 0) 0x7fa2e405a370 con 0x7fa2f810b440 2024-09-06T15:14:46.614 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.618+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== osd.6 v1:172.21.15.190:6808/507475988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa2e8086690 con 0x7fa2e80829c0 2024-09-06T15:14:46.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 --> v1:172.21.15.190:6808/507475988 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2d8002c70 con 0x7fa2e80829c0 2024-09-06T15:14:46.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2f5ffb640 1 -- 172.21.15.189:0/3755709165 <== osd.6 v1:172.21.15.190:6808/507475988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 1554332108) 0x7fa2d8002c70 con 0x7fa2e80829c0 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 >> v1:172.21.15.190:6808/507475988 conn(0x7fa2e80829c0 legacy=0x7fa2e8084e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 >> v1:172.21.15.189:6800/1420554776 conn(0x7fa2e8078430 legacy=0x7fa2e807a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 >> v1:172.21.15.189:6789/0 conn(0x7fa2f810b440 legacy=0x7fa2f81a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2fd0f9640 1 -- 172.21.15.189:0/3755709165 reap_dead start 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 shutdown_connections 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 >> 172.21.15.189:0/3755709165 conn(0x7fa2f8078d60 msgr2=0x7fa2f80fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:46.630 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 shutdown_connections 2024-09-06T15:14:46.631 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:46.634+0000 7fa2e37fe640 1 -- 172.21.15.189:0/3755709165 wait complete. 2024-09-06T15:14:46.791 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.516530523Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.527832546Z level=info msg="Migration successfully executed" id="add column current_state_end to alert_instance" duration=11.303297ms 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.558485128Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.560518119Z level=info msg="Migration successfully executed" id="remove index def_org_id, def_uid, current_state on alert_instance" duration=2.034247ms 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.608785346Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.610849322Z level=info msg="Migration successfully executed" id="remove index def_org_id, current_state on alert_instance" duration=2.066393ms 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.65942266Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.71027187Z level=info msg="Migration successfully executed" id="rename def_org_id to rule_org_id in alert_instance" duration=50.850153ms 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.751376346Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-06T15:14:46.792 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.800603135Z level=info msg="Migration successfully executed" id="rename def_uid to rule_uid in alert_instance" duration=49.23271ms 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.843380338Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.845350641Z level=info msg="Migration successfully executed" id="add index rule_org_id, rule_uid, current_state on alert_instance" duration=1.970646ms 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.876994605Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.878941026Z level=info msg="Migration successfully executed" id="add index rule_org_id, current_state on alert_instance" duration=1.945469ms 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.90220792Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-06T15:14:47.053 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.912142783Z level=info msg="Migration successfully executed" id="add current_reason column related to current_state" duration=9.936574ms 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.935840759Z level=info msg="Executing migration" id="add result_fingerprint column to alert_instance" 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.945243068Z level=info msg="Migration successfully executed" id="add result_fingerprint column to alert_instance" duration=9.400463ms 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.96952016Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.971549783Z level=info msg="Migration successfully executed" id="create alert_rule table" duration=2.028566ms 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.994754592Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:46 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:46.996729424Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and title columns" duration=1.975889ms 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.019960644Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.02198315Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id and uid columns" duration=2.022697ms 2024-09-06T15:14:47.054 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.061975871Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-06T15:14:47.305 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.064394503Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" duration=2.417833ms 2024-09-06T15:14:47.305 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.087261208Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-06T15:14:47.305 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.08743387Z level=info msg="Migration successfully executed" id="alter alert_rule table data column to mediumtext in mysql" duration=172.989µs 2024-09-06T15:14:47.305 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.129084909Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-06T15:14:47.305 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.140062452Z level=info msg="Migration successfully executed" id="add column for to alert_rule" duration=10.97689ms 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.162913983Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.17345078Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule" duration=10.535967ms 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.196518623Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.207061437Z level=info msg="Migration successfully executed" id="add column labels to alert_rule" duration=10.541531ms 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.246707799Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.248544501Z level=info msg="Migration successfully executed" id="remove unique index from alert_rule on org_id, title columns" duration=1.836058ms 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.288846899Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.29088109Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, namespase_uid and title columns" duration=2.029385ms 2024-09-06T15:14:47.306 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.314106707Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-06T15:14:47.574 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.3248046Z level=info msg="Migration successfully executed" id="add dashboard_uid column to alert_rule" duration=10.698216ms 2024-09-06T15:14:47.574 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.3477411Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-06T15:14:47.574 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.35838557Z level=info msg="Migration successfully executed" id="add panel_id column to alert_rule" duration=10.643447ms 2024-09-06T15:14:47.574 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.381363187Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.383387041Z level=info msg="Migration successfully executed" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" duration=2.030327ms 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.406621128Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.417201058Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule" duration=10.578584ms 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.456878146Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.467677568Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule table" duration=10.798332ms 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.507213624Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.507346016Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule table" duration=133.468µs 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.532493838Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.534816889Z level=info msg="Migration successfully executed" id="create alert_rule_version table" duration=2.322471ms 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.557816292Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.559905852Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" duration=2.08841ms 2024-09-06T15:14:47.575 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.582968691Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-06T15:14:47.832 INFO:teuthology.orchestra.run.smithi189.stdout:210453397534 2024-09-06T15:14:47.832 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.585274579Z level=info msg="Migration successfully executed" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" duration=2.304941ms 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.625001186Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.625155264Z level=info msg="Migration successfully executed" id="alter alert_rule_version table data column to mediumtext in mysql" duration=152.862µs 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.650106955Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.661493658Z level=info msg="Migration successfully executed" id="add column for to alert_rule_version" duration=11.385093ms 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.683810658Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-06T15:14:47.834 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.695179874Z level=info msg="Migration successfully executed" id="add column annotations to alert_rule_version" duration=11.368123ms 2024-09-06T15:14:47.835 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.72578576Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-06T15:14:47.835 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.737200432Z level=info msg="Migration successfully executed" id="add column labels to alert_rule_version" duration=11.415879ms 2024-09-06T15:14:47.835 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.784648418Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-06T15:14:47.835 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.79580032Z level=info msg="Migration successfully executed" id="add rule_group_idx column to alert_rule_version" duration=11.146642ms 2024-09-06T15:14:47.835 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.843249665Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-06T15:14:47.845 INFO:teuthology.orchestra.run.smithi189.stdout:158913790003 2024-09-06T15:14:47.845 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-06T15:14:47.879 INFO:teuthology.orchestra.run.smithi189.stdout:77309411412 2024-09-06T15:14:47.880 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-06T15:14:48.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:47 smithi189 bash[22757]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:47 smithi189 bash[22757]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:47 smithi189 bash[29727]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:47 smithi189 bash[29727]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[24979]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.102 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[24979]: cluster 2024-09-06T15:14:47.812691+0000 mgr.y (mgr.14631) 64 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.854298727Z level=info msg="Migration successfully executed" id="add is_paused column to alert_rule_versions table" duration=11.042539ms 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.901877085Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.90205565Z level=info msg="Migration successfully executed" id="fix is_paused column for alert_rule_version table" duration=180.141µs 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.952327514Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.954048282Z level=info msg="Migration successfully executed" id=create_alert_configuration_table duration=1.719783ms 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.985941047Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:47 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:47.997271708Z level=info msg="Migration successfully executed" id="Add column default in alert_configuration" duration=11.332648ms 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.044515443Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.044685704Z level=info msg="Migration successfully executed" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" duration=167.442µs 2024-09-06T15:14:48.103 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.078119207Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-06T15:14:48.104 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.090535686Z level=info msg="Migration successfully executed" id="add column org_id in alert_configuration" duration=12.414986ms 2024-09-06T15:14:48.104 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.111808382Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-06T15:14:48.363 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.114119556Z level=info msg="Migration successfully executed" id="add index in alert_configuration table on org_id column" duration=2.312215ms 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.137005705Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.14844157Z level=info msg="Migration successfully executed" id="add configuration_hash column to alert_configuration" duration=11.437349ms 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.170517269Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.172128153Z level=info msg="Migration successfully executed" id=create_ngalert_configuration_table duration=1.608588ms 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.212556697Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.214635044Z level=info msg="Migration successfully executed" id="add index in ngalert_configuration on org_id column" duration=2.07919ms 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.237837288Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.249282737Z level=info msg="Migration successfully executed" id="add column send_alerts_to in ngalert_configuration" duration=11.444589ms 2024-09-06T15:14:48.364 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.271340053Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.27297645Z level=info msg="Migration successfully executed" id="create provenance_type table" duration=1.635604ms 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.313312778Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.315459794Z level=info msg="Migration successfully executed" id="add index to uniquify (record_key, record_type, org_id) columns" duration=2.145868ms 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.355536785Z level=info msg="Executing migration" id="create alert_image table" 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.357284198Z level=info msg="Migration successfully executed" id="create alert_image table" duration=1.748009ms 2024-09-06T15:14:48.365 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.372382098Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-06T15:14:48.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.374728259Z level=info msg="Migration successfully executed" id="add unique index on token to alert_image table" duration=2.346067ms 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.414271968Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.414416603Z level=info msg="Migration successfully executed" id="support longer URLs in alert_image table" duration=147.445µs 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.439621898Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.441593079Z level=info msg="Migration successfully executed" id=create_alert_configuration_history_table duration=1.973764ms 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.464897189Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.466873933Z level=info msg="Migration successfully executed" id="drop non-unique orgID index on alert_configuration" duration=1.976414ms 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.506753166Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.507603828Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.531987948Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.532895812Z level=info msg="Migration successfully executed" id="extract alertmanager configuration history to separate table" duration=907.688µs 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.573971746Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-06T15:14:48.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.575931697Z level=info msg="Migration successfully executed" id="add unique index on orgID to alert_configuration" duration=1.961128ms 2024-09-06T15:14:48.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.599309717Z level=info msg="Executing migration" id="add last_applied column to alert_configuration_history" 2024-09-06T15:14:48.623 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.611414459Z level=info msg="Migration successfully executed" id="add last_applied column to alert_configuration_history" duration=12.103963ms 2024-09-06T15:14:48.759 INFO:teuthology.orchestra.run.smithi189.stdout:184683593770 2024-09-06T15:14:48.760 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.649650904Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.65183692Z level=info msg="Migration successfully executed" id="create library_element table v1" duration=2.185369ms 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.674899263Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.676998412Z level=info msg="Migration successfully executed" id="add index library_element org_id-folder_id-name-kind" duration=2.098362ms 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.716911912Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.718653391Z level=info msg="Migration successfully executed" id="create library_element_connection table v1" duration=1.742366ms 2024-09-06T15:14:48.893 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.783895581Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.786012677Z level=info msg="Migration successfully executed" id="add index library_element_connection element_id-kind-connection_id" duration=2.117676ms 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.809154171Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.811221675Z level=info msg="Migration successfully executed" id="add unique index library_element org_id_uid" duration=2.068263ms 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.851314526Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.851399741Z level=info msg="Migration successfully executed" id="increase max description length to 2048" duration=87.709µs 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.876625203Z level=info msg="Executing migration" id="alter library_element model to mediumtext" 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.876788399Z level=info msg="Migration successfully executed" id="alter library_element model to mediumtext" duration=167.928µs 2024-09-06T15:14:48.894 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.901830352Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-06T15:14:49.144 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.902464685Z level=info msg="Migration successfully executed" id="clone move dashboard alerts to unified alerting" duration=632.404µs 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.927085203Z level=info msg="Executing migration" id="create data_keys table" 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.9291575Z level=info msg="Migration successfully executed" id="create data_keys table" duration=2.071693ms 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.952401997Z level=info msg="Executing migration" id="create secrets table" 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:48 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:48.954394187Z level=info msg="Migration successfully executed" id="create secrets table" duration=1.99345ms 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.01112592Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.072180602Z level=info msg="Migration successfully executed" id="rename data_keys name column to id" duration=61.071408ms 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.11965001Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.132427501Z level=info msg="Migration successfully executed" id="add name column into data_keys" duration=12.776525ms 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.153448618Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-06T15:14:49.145 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.153848734Z level=info msg="Migration successfully executed" id="copy data_keys id column values into name" duration=399.286µs 2024-09-06T15:14:49.412 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.178559251Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-06T15:14:49.412 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.240169074Z level=info msg="Migration successfully executed" id="rename data_keys name column to label" duration=61.610141ms 2024-09-06T15:14:49.413 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.287182514Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-06T15:14:49.413 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.339322609Z level=info msg="Migration successfully executed" id="rename data_keys id column back to name" duration=52.139323ms 2024-09-06T15:14:49.413 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.379271683Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-06T15:14:49.413 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.38088604Z level=info msg="Migration successfully executed" id="create kv_store table v1" duration=1.615365ms 2024-09-06T15:14:49.413 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.421248321Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.423544339Z level=info msg="Migration successfully executed" id="add index kv_store.org_id-namespace-key" duration=2.295091ms 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.446464759Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.446939065Z level=info msg="Migration successfully executed" id="update dashboard_uid and panel_id from existing annotations" duration=474.556µs 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.463323536Z level=info msg="Executing migration" id="create permission table" 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.465147651Z level=info msg="Migration successfully executed" id="create permission table" duration=1.823456ms 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.497034355Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-06T15:14:49.682 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.499041699Z level=info msg="Migration successfully executed" id="add unique index permission.role_id" duration=2.006577ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.513948958Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.516105517Z level=info msg="Migration successfully executed" id="add unique index role_id_action_scope" duration=2.155689ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.539220052Z level=info msg="Executing migration" id="create role table" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.541296815Z level=info msg="Migration successfully executed" id="create role table" duration=2.075794ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.556094652Z level=info msg="Executing migration" id="add column display_name" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.569905821Z level=info msg="Migration successfully executed" id="add column display_name" duration=13.810122ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.589683606Z level=info msg="Executing migration" id="add column group_name" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.602699669Z level=info msg="Migration successfully executed" id="add column group_name" duration=13.015116ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.623195121Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.625262764Z level=info msg="Migration successfully executed" id="add index role.org_id" duration=2.06717ms 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.665164086Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-06T15:14:49.683 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.667354698Z level=info msg="Migration successfully executed" id="add unique index role_org_id_name" duration=2.189849ms 2024-09-06T15:14:49.684 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.690338175Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-06T15:14:49.950 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[24979]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:49.950 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[24979]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.692707172Z level=info msg="Migration successfully executed" id="add index role_org_id_uid" duration=2.368317ms 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.732432603Z level=info msg="Executing migration" id="create team role table" 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.734258552Z level=info msg="Migration successfully executed" id="create team role table" duration=1.824989ms 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.774217277Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.776463599Z level=info msg="Migration successfully executed" id="add index team_role.org_id" duration=2.245655ms 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.799667737Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.802093776Z level=info msg="Migration successfully executed" id="add unique index team_role_org_id_team_id_role_id" duration=2.426242ms 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.841683722Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.843802655Z level=info msg="Migration successfully executed" id="add index team_role.team_id" duration=2.119277ms 2024-09-06T15:14:49.951 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.866894767Z level=info msg="Executing migration" id="create user role table" 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.868717326Z level=info msg="Migration successfully executed" id="create user role table" duration=1.826042ms 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.908763277Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.911103828Z level=info msg="Migration successfully executed" id="add index user_role.org_id" duration=2.342251ms 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.934143474Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.936286117Z level=info msg="Migration successfully executed" id="add unique index user_role_org_id_user_id_role_id" duration=2.146196ms 2024-09-06T15:14:49.952 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.959747376Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-06T15:14:50.015 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:49 smithi189 bash[22757]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:50.015 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:49 smithi189 bash[22757]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:50.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:49 smithi189 bash[29727]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:50.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:49 smithi189 bash[29727]: cluster 2024-09-06T15:14:49.813123+0000 mgr.y (mgr.14631) 65 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.962252478Z level=info msg="Migration successfully executed" id="add index user_role.user_id" duration=2.505589ms 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.99333161Z level=info msg="Executing migration" id="create builtin role table" 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:49 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:49.995112709Z level=info msg="Migration successfully executed" id="create builtin role table" duration=1.780433ms 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.07702916Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.079469324Z level=info msg="Migration successfully executed" id="add index builtin_role.role_id" duration=2.440754ms 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.119051653Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.121208718Z level=info msg="Migration successfully executed" id="add index builtin_role.name" duration=2.159318ms 2024-09-06T15:14:50.236 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.161026365Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-06T15:14:50.237 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.175449669Z level=info msg="Migration successfully executed" id="Add column org_id to builtin_role table" duration=14.422623ms 2024-09-06T15:14:50.237 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.202877899Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-06T15:14:50.237 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.204961728Z level=info msg="Migration successfully executed" id="add index builtin_role.org_id" duration=2.083586ms 2024-09-06T15:14:50.237 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.244981657Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-06T15:14:50.513 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.247259258Z level=info msg="Migration successfully executed" id="add unique index builtin_role_org_id_role_id_role" duration=2.276752ms 2024-09-06T15:14:50.513 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.312262431Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.31441637Z level=info msg="Migration successfully executed" id="Remove unique index role_org_id_uid" duration=2.153986ms 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.337526935Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.339594239Z level=info msg="Migration successfully executed" id="add unique index role.uid" duration=2.124553ms 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.379519074Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.381197892Z level=info msg="Migration successfully executed" id="create seed assignment table" duration=1.679867ms 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.404775823Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.406977865Z level=info msg="Migration successfully executed" id="add unique index builtin_role_role_name" duration=2.201008ms 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.430038441Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.444501764Z level=info msg="Migration successfully executed" id="add column hidden to role table" duration=14.462243ms 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.471841815Z level=info msg="Executing migration" id="permission kind migration" 2024-09-06T15:14:50.514 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.486659702Z level=info msg="Migration successfully executed" id="permission kind migration" duration=14.819067ms 2024-09-06T15:14:50.515 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.52211977Z level=info msg="Executing migration" id="permission attribute migration" 2024-09-06T15:14:50.723 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:50 smithi189 systemd[1]: Stopping Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:14:50.723 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[58052]: ts=2024-09-06T15:14:50.543Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.536275373Z level=info msg="Migration successfully executed" id="permission attribute migration" duration=14.153156ms 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.572391486Z level=info msg="Executing migration" id="permission identifier migration" 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.586625914Z level=info msg="Migration successfully executed" id="permission identifier migration" duration=14.232812ms 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.614326135Z level=info msg="Executing migration" id="add permission identifier index" 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.616534224Z level=info msg="Migration successfully executed" id="add permission identifier index" duration=2.202725ms 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.656382527Z level=info msg="Executing migration" id="add permission action scope role_id index" 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.658811353Z level=info msg="Migration successfully executed" id="add permission action scope role_id index" duration=2.426893ms 2024-09-06T15:14:50.824 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.69837774Z level=info msg="Executing migration" id="remove permission role_id action scope index" 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.700512763Z level=info msg="Migration successfully executed" id="remove permission role_id action scope index" duration=2.134812ms 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.740366956Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.74230235Z level=info msg="Migration successfully executed" id="create query_history table v1" duration=1.934478ms 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.765660827Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.767848502Z level=info msg="Migration successfully executed" id="add index query_history.org_id-created_by-datasource_uid" duration=2.186936ms 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.832742582Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-06T15:14:50.825 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.832878591Z level=info msg="Migration successfully executed" id="alter table query_history alter column created_by type to bigint" duration=137.113µs 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[22757]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[22757]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[22757]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[22757]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[29727]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[29727]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[29727]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.009 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:50 smithi189 bash[29727]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.084 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:14:51.084 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[24979]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.085 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[24979]: audit 2024-09-06T15:14:50.252993+0000 mon.c (mon.2) 64 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:51.085 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[24979]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.085 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[24979]: audit 2024-09-06T15:14:50.835422+0000 mgr.y (mgr.14631) 66 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.874636205Z level=info msg="Executing migration" id="rbac disabled migrator" 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.874692874Z level=info msg="Migration successfully executed" id="rbac disabled migrator" duration=59.11µs 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.91677147Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.917695088Z level=info msg="Migration successfully executed" id="teams permissions migration" duration=924.075µs 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.942076217Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.943112994Z level=info msg="Migration successfully executed" id="dashboard permissions" duration=1.036167ms 2024-09-06T15:14:51.085 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.967310943Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.968680996Z level=info msg="Migration successfully executed" id="dashboard permissions uid scopes" duration=1.371717ms 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.992563194Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:50 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:50.993089408Z level=info msg="Migration successfully executed" id="drop managed folder create actions" duration=528.152µs 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.017758866Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.01869896Z level=info msg="Migration successfully executed" id="alerting notification permissions" duration=940.068µs 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.043267608Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.044945395Z level=info msg="Migration successfully executed" id="create query_history_star table v1" duration=1.677004ms 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.068534587Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.070706793Z level=info msg="Migration successfully executed" id="add index query_history.user_id-query_uid" duration=2.171369ms 2024-09-06T15:14:51.086 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.093791202Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-06T15:14:51.347 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:51 smithi189 bash[60482]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-alertmanager-a 2024-09-06T15:14:51.347 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:51 smithi189 bash[60541]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-alertmanager-a 2024-09-06T15:14:51.347 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:51 smithi189 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-06T15:14:51.347 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:51 smithi189 systemd[1]: Stopped Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:51.347 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:51 smithi189 systemd[1]: Started Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:51.370 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.108062217Z level=info msg="Migration successfully executed" id="add column org_id in query_history_star" duration=14.273184ms 2024-09-06T15:14:51.370 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.144008018Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-06T15:14:51.370 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.144164017Z level=info msg="Migration successfully executed" id="alter table query_history_star_mig column user_id type to bigint" duration=156.092µs 2024-09-06T15:14:51.370 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.169429757Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.171726039Z level=info msg="Migration successfully executed" id="create correlation table v1" duration=2.295478ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.186323108Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.188459513Z level=info msg="Migration successfully executed" id="add index correlations.uid" duration=2.136819ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.22826832Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.230454666Z level=info msg="Migration successfully executed" id="add index correlations.source_uid" duration=2.185832ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.253541992Z level=info msg="Executing migration" id="add correlation config column" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.268747094Z level=info msg="Migration successfully executed" id="add correlation config column" duration=15.204282ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.312384821Z level=info msg="Executing migration" id="drop index IDX_correlation_uid - v1" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.314644479Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_uid - v1" duration=2.260718ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.337512737Z level=info msg="Executing migration" id="drop index IDX_correlation_source_uid - v1" 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.339644733Z level=info msg="Migration successfully executed" id="drop index IDX_correlation_source_uid - v1" duration=2.131542ms 2024-09-06T15:14:51.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.37943546Z level=info msg="Executing migration" id="Rename table correlation to correlation_tmp_qwerty - v1" 2024-09-06T15:14:51.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.424342809Z level=info msg="Migration successfully executed" id="Rename table correlation to correlation_tmp_qwerty - v1" duration=44.90848ms 2024-09-06T15:14:51.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.446414125Z level=info msg="Executing migration" id="create correlation v2" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.448552775Z level=info msg="Migration successfully executed" id="create correlation v2" duration=2.137248ms 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.471654476Z level=info msg="Executing migration" id="create index IDX_correlation_uid - v2" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.473884804Z level=info msg="Migration successfully executed" id="create index IDX_correlation_uid - v2" duration=2.226152ms 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.513583012Z level=info msg="Executing migration" id="create index IDX_correlation_source_uid - v2" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.515927613Z level=info msg="Migration successfully executed" id="create index IDX_correlation_source_uid - v2" duration=2.346408ms 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.539023769Z level=info msg="Executing migration" id="create index IDX_correlation_org_id - v2" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.541522401Z level=info msg="Migration successfully executed" id="create index IDX_correlation_org_id - v2" duration=2.49982ms 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.564146525Z level=info msg="Executing migration" id="copy correlation v1 to v2" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.564754969Z level=info msg="Migration successfully executed" id="copy correlation v1 to v2" duration=608.841µs 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.589376153Z level=info msg="Executing migration" id="drop correlation_tmp_qwerty" 2024-09-06T15:14:51.622 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.591397907Z level=info msg="Migration successfully executed" id="drop correlation_tmp_qwerty" duration=2.020971ms 2024-09-06T15:14:51.695 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:51.695 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.631380426Z level=info msg="Executing migration" id="add provisioning column" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.641669667Z level=info msg="Migration successfully executed" id="add provisioning column" duration=10.287021ms 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.664792628Z level=info msg="Executing migration" id="create entity_events table" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.666049694Z level=info msg="Migration successfully executed" id="create entity_events table" duration=1.260083ms 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.706660899Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.708114346Z level=info msg="Migration successfully executed" id="create dashboard public config v1" duration=1.455772ms 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.731838547Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.732436068Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.756972366Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.757524175Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.798983025Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-06T15:14:51.883 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.800112259Z level=info msg="Migration successfully executed" id="Drop old dashboard public config table" duration=1.127989ms 2024-09-06T15:14:51.884 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.841115878Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-06T15:14:51.884 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.842495041Z level=info msg="Migration successfully executed" id="recreate dashboard public config v1" duration=1.381463ms 2024-09-06T15:14:51.884 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.866356073Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-06T15:14:51.884 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.8676551Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v1" duration=1.299851ms 2024-09-06T15:14:51.884 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.891663839Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.893129369Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" duration=1.466381ms 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.916870835Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.918219464Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_public_config_uid - v2" duration=1.350128ms 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.941968473Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.943256392Z level=info msg="Migration successfully executed" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=1.286725ms 2024-09-06T15:14:52.160 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.984011242Z level=info msg="Executing migration" id="Drop public config table" 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:51 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:51.985082247Z level=info msg="Migration successfully executed" id="Drop public config table" duration=1.087638ms 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.026026291Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.027398012Z level=info msg="Migration successfully executed" id="Recreate dashboard public config v2" duration=1.370273ms 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.110082196Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.111635625Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_uid - v2" duration=1.553654ms 2024-09-06T15:14:52.161 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.169124695Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-06T15:14:52.436 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.171570562Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" duration=2.448445ms 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.437 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.438 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.438 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[24979]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:14:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[29727]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: audit 2024-09-06T15:14:51.269175+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: audit 2024-09-06T15:14:51.282526+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cephadm 2024-09-06T15:14:51.291641+0000 mgr.y (mgr.14631) 67 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cephadm 2024-09-06T15:14:51.533875+0000 mgr.y (mgr.14631) 68 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi190 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:52 smithi189 bash[22757]: cluster 2024-09-06T15:14:51.813879+0000 mgr.y (mgr.14631) 69 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:52.961 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.44606202Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-06T15:14:52.961 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.44879323Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_public_config_access_token - v2" duration=2.732757ms 2024-09-06T15:14:52.962 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.546284328Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-06T15:14:52.962 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:52 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:52.595483205Z level=info msg="Migration successfully executed" id="Rename table dashboard_public_config to dashboard_public - v2" duration=49.20441ms 2024-09-06T15:14:53.281 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.039345136Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-06T15:14:53.281 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.054986345Z level=info msg="Migration successfully executed" id="add annotations_enabled column" duration=15.643573ms 2024-09-06T15:14:53.281 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.223749619Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-06T15:14:53.281 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.238981464Z level=info msg="Migration successfully executed" id="add time_selection_enabled column" duration=15.234099ms 2024-09-06T15:14:53.597 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.309Z caller=main.go:181 level=info msg="Starting Alertmanager" version="(version=0.27.0, branch=HEAD, revision=0aa3c2aad14cff039931923ab16b26b7481783b5)" 2024-09-06T15:14:53.597 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.310Z caller=main.go:182 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@22cd11f671e9, date=20240228-11:51:20, tags=netgo)" 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.311Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.189 port=9094 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.312Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.341Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.341Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.343Z caller=tls_config.go:313 level=info msg="Listening on" address=[::]:9093 2024-09-06T15:14:53.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[60570]: ts=2024-09-06T15:14:53.343Z caller=tls_config.go:316 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-06T15:14:53.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.290599608Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-06T15:14:53.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.291179552Z level=info msg="Migration successfully executed" id="delete orphaned public dashboards" duration=579.861µs 2024-09-06T15:14:53.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.408924829Z level=info msg="Executing migration" id="add share column" 2024-09-06T15:14:53.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.42437648Z level=info msg="Migration successfully executed" id="add share column" duration=15.453534ms 2024-09-06T15:14:53.731 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.731 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.733 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.733 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.736 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.736 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:14:53.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.749+0000 7ff0090cc640 1 -- 172.21.15.189:0/4090527888 >> v1:172.21.15.189:6790/0 conn(0x7ff00410d640 legacy=0x7ff00410fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.749+0000 7ff0090cc640 1 -- 172.21.15.189:0/4090527888 shutdown_connections 2024-09-06T15:14:53.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.749+0000 7ff0090cc640 1 -- 172.21.15.189:0/4090527888 >> 172.21.15.189:0/4090527888 conn(0x7ff004100520 msgr2=0x7ff004102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:53.747 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- 172.21.15.189:0/4090527888 shutdown_connections 2024-09-06T15:14:53.748 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- 172.21.15.189:0/4090527888 wait complete. 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 Processor -- start 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- start start 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff002d9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7ff00410d640 0x7ff004110a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44640/0 (socket says 172.21.15.189:44640) 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff002d9d640 1 -- 172.21.15.189:0/3158457828 learned_addr learned my addr 172.21.15.189:0/3158457828 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff0041a9ca0 con 0x7ff0041a5ee0 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff0041aaea0 con 0x7ff0041111e0 2024-09-06T15:14:53.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7ff0090cc640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff0041ac0a0 con 0x7ff00410d640 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262434981 0 0) 0x7ff0041ac0a0 con 0x7ff00410d640 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefec003520 con 0x7ff00410d640 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512949324 0 0) 0x7ff0041a9ca0 con 0x7ff0041a5ee0 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0041ac0a0 con 0x7ff0041a5ee0 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431623962 0 0) 0x7ff0041aaea0 con 0x7ff0041111e0 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0041a9ca0 con 0x7ff0041111e0 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2793392728 0 0) 0x7fefec003520 con 0x7ff00410d640 2024-09-06T15:14:53.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0041aaea0 con 0x7ff00410d640 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7feff8003ff0 con 0x7ff00410d640 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3667809687 0 0) 0x7ff0041ac0a0 con 0x7ff0041a5ee0 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefec003520 con 0x7ff0041a5ee0 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7feffc001bb0 con 0x7ff0041a5ee0 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2967530383 0 0) 0x7ff0041aaea0 con 0x7ff00410d640 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.753+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 >> v1:172.21.15.190:6789/0 conn(0x7ff0041111e0 legacy=0x7ff0041a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 >> v1:172.21.15.189:6789/0 conn(0x7ff0041a5ee0 legacy=0x7ff0041a83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0041a9f10 con 0x7ff00410d640 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7ff0090cc640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0041aa200 con 0x7ff00410d640 2024-09-06T15:14:53.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7ff0090cc640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0041aa830 con 0x7ff00410d640 2024-09-06T15:14:53.753 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7feff8001340 con 0x7ff00410d640 2024-09-06T15:14:53.753 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7feff8005ae0 con 0x7ff00410d640 2024-09-06T15:14:53.753 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe4005080 con 0x7ff00410d640 2024-09-06T15:14:53.753 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7feff8006db0 con 0x7ff00410d640 2024-09-06T15:14:53.754 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.757+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7feff8094ba0 con 0x7ff00410d640 2024-09-06T15:14:53.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.765+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7feff805e850 con 0x7ff00410d640 2024-09-06T15:14:53.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/371625214 >> v1:172.21.15.189:6790/0 conn(0x7f95dc10b440 legacy=0x7f95dc10d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/371625214 shutdown_connections 2024-09-06T15:14:53.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/371625214 >> 172.21.15.189:0/371625214 conn(0x7f95dc0fe360 msgr2=0x7f95dc100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:53.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/371625214 shutdown_connections 2024-09-06T15:14:53.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/371625214 wait complete. 2024-09-06T15:14:53.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 Processor -- start 2024-09-06T15:14:53.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- start start 2024-09-06T15:14:53.795 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95dbfff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f95dc1028d0 0x7f95dc0769e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44658/0 (socket says 172.21.15.189:44658) 2024-09-06T15:14:53.795 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e0a13640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f95dc10efe0 0x7f95dc1a7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40380/0 (socket says 172.21.15.189:40380) 2024-09-06T15:14:53.795 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95dbfff640 1 -- 172.21.15.189:0/1631701613 learned_addr learned my addr 172.21.15.189:0/1631701613 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:53.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f95dc1a9700 con 0x7f95dc10efe0 2024-09-06T15:14:53.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f95dc1aa8e0 con 0x7f95dc10b440 2024-09-06T15:14:53.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.797+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f95dc1a98f0 con 0x7f95dc1028d0 2024-09-06T15:14:53.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766031435 0 0) 0x7f95dc1a9700 con 0x7f95dc10efe0 2024-09-06T15:14:53.796 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c4003520 con 0x7f95dc10efe0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255370970 0 0) 0x7f95dc1a98f0 con 0x7f95dc1028d0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95dc1a9700 con 0x7f95dc1028d0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312216194 0 0) 0x7f95dc1aa8e0 con 0x7f95dc10b440 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95dc1a98f0 con 0x7f95dc10b440 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1113409547 0 0) 0x7f95dc1a9700 con 0x7f95dc1028d0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95dc1aa8e0 con 0x7f95dc1028d0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f95cc001970 con 0x7f95dc1028d0 2024-09-06T15:14:53.797 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1460077212 0 0) 0x7f95c4003520 con 0x7f95dc10efe0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95dc1a9700 con 0x7f95dc10efe0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f95d4001730 con 0x7f95dc10efe0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3586374929 0 0) 0x7f95dc1a98f0 con 0x7f95dc10b440 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95c4003520 con 0x7f95dc10b440 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3115304012 0 0) 0x7f95dc1aa8e0 con 0x7f95dc1028d0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 >> v1:172.21.15.190:6789/0 conn(0x7f95dc10b440 legacy=0x7f95dc1a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 >> v1:172.21.15.189:6789/0 conn(0x7f95dc10efe0 legacy=0x7f95dc1a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc1a9b80 con 0x7f95dc1028d0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc1a9e70 con 0x7f95dc1028d0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f95cc003a80 con 0x7f95dc1028d0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f95cc005b50 con 0x7f95dc1028d0 2024-09-06T15:14:53.798 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f95dc1aa4a0 con 0x7f95dc1028d0 2024-09-06T15:14:53.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc103b80 con 0x7f95dc1028d0 2024-09-06T15:14:53.799 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.801+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f95cc003610 con 0x7f95dc1028d0 2024-09-06T15:14:53.800 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.805+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f95cc094ce0 con 0x7f95dc1028d0 2024-09-06T15:14:53.802 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.805+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f95cc05dc60 con 0x7f95dc1028d0 2024-09-06T15:14:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.961+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fefe4005370 con 0x7ff00410d640 2024-09-06T15:14:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.961+0000 7fefebfff640 1 -- 172.21.15.189:0/3158457828 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (unknown 1823589948 0 1281650069) 0x7feff80629c0 con 0x7ff00410d640 2024-09-06T15:14:53.958 INFO:teuthology.orchestra.run.smithi189.stdout:133143986241 2024-09-06T15:14:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 >> v1:172.21.15.189:6800/1420554776 conn(0x7fefec0783a0 legacy=0x7fefec07a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 >> v1:172.21.15.189:6790/0 conn(0x7ff00410d640 legacy=0x7ff004110a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 shutdown_connections 2024-09-06T15:14:53.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 >> 172.21.15.189:0/3158457828 conn(0x7ff004100520 msgr2=0x7ff0041030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:53.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 shutdown_connections 2024-09-06T15:14:53.961 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.965+0000 7fefe9ffb640 1 -- 172.21.15.189:0/3158457828 wait complete. 2024-09-06T15:14:53.963 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[24979]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:53.963 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[24979]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:53.963 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.687614368Z level=info msg="Executing migration" id="backfill empty share column fields with default of public" 2024-09-06T15:14:53.963 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.688108276Z level=info msg="Migration successfully executed" id="backfill empty share column fields with default of public" duration=493.901µs 2024-09-06T15:14:53.963 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.851152413Z level=info msg="Executing migration" id="create file table" 2024-09-06T15:14:53.963 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.853597193Z level=info msg="Migration successfully executed" id="create file table" duration=2.442803ms 2024-09-06T15:14:53.964 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.91030999Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-06T15:14:53.964 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.912762632Z level=info msg="Migration successfully executed" id="file table idx: path natural pk" duration=2.461903ms 2024-09-06T15:14:53.964 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.972636265Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-06T15:14:53.982 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.985+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f95dc076440 con 0x7f95dc1028d0 2024-09-06T15:14:53.983 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.985+0000 7f95d97fa640 1 -- 172.21.15.189:0/1631701613 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1252279532) 0x7f95dc076440 con 0x7f95dc1028d0 2024-09-06T15:14:53.983 INFO:teuthology.orchestra.run.smithi189.stdout:34359738476 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 >> v1:172.21.15.189:6800/1420554776 conn(0x7f95c4078440 legacy=0x7f95c407a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 >> v1:172.21.15.189:6790/0 conn(0x7f95dc1028d0 legacy=0x7f95dc0769e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 shutdown_connections 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 >> 172.21.15.189:0/1631701613 conn(0x7f95dc0fe360 msgr2=0x7f95dc1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 shutdown_connections 2024-09-06T15:14:53.985 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:53.989+0000 7f95e2476640 1 -- 172.21.15.189:0/1631701613 wait complete. 2024-09-06T15:14:54.224 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:53 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:53.975054328Z level=info msg="Migration successfully executed" id="file table idx: parent_folder_path_hash fast folder retrieval" duration=2.41799ms 2024-09-06T15:14:54.225 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.036266485Z level=info msg="Executing migration" id="create file_meta table" 2024-09-06T15:14:54.225 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.038184524Z level=info msg="Migration successfully executed" id="create file_meta table" duration=1.918575ms 2024-09-06T15:14:54.225 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.137011036Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-06T15:14:54.225 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.139493975Z level=info msg="Migration successfully executed" id="file table idx: path key" duration=2.482396ms 2024-09-06T15:14:54.225 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.23362382Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-06T15:14:54.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[22757]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:54.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[22757]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:54.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[29727]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:54.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:53 smithi189 bash[29727]: cluster 2024-09-06T15:14:53.814256+0000 mgr.y (mgr.14631) 70 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.233811231Z level=info msg="Migration successfully executed" id="set path collation in file table" duration=172.244µs 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.287890167Z level=info msg="Executing migration" id="migrate contents column to mediumblob for MySQL" 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.288041071Z level=info msg="Migration successfully executed" id="migrate contents column to mediumblob for MySQL" duration=154.837µs 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.330007826Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.330627387Z level=info msg="Migration successfully executed" id="managed permissions migration" duration=621.455µs 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.38121428Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-06T15:14:54.489 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.381825347Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions migration" duration=612.534µs 2024-09-06T15:14:54.490 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.439936434Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-06T15:14:54.490 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.441314378Z level=info msg="Migration successfully executed" id="RBAC action name migrator" duration=1.384394ms 2024-09-06T15:14:54.490 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.498527958Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-06T15:14:54.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.505456963Z level=info msg="Migration successfully executed" id="Add UID column to playlist" duration=6.929513ms 2024-09-06T15:14:54.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.582398003Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-06T15:14:54.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.582795773Z level=info msg="Migration successfully executed" id="Update uid column values in playlist" duration=397.843µs 2024-09-06T15:14:54.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.65214388Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-06T15:14:54.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.654609389Z level=info msg="Migration successfully executed" id="Add index for uid in playlist" duration=2.467006ms 2024-09-06T15:14:55.258 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.903599708Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-06T15:14:55.259 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:54.904538025Z level=info msg="Migration successfully executed" id="update group index for alert rules" duration=941.791µs 2024-09-06T15:14:55.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[24979]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[24979]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[24979]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.259 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:54 smithi190 bash[24979]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[22757]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[22757]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[22757]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[22757]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[29727]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[29727]: audit 2024-09-06T15:14:53.965474+0000 mon.c (mon.2) 65 : audit [DBG] from='client.? v1:172.21.15.189:0/3158457828' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-06T15:14:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[29727]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:54 smithi189 bash[29727]: audit 2024-09-06T15:14:53.990117+0000 mon.c (mon.2) 66 : audit [DBG] from='client.? v1:172.21.15.189:0/1631701613' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-06T15:14:55.527 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.267631565Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-06T15:14:55.527 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.268283345Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated migration" duration=652.083µs 2024-09-06T15:14:55.527 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.452209181Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-06T15:14:55.528 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.453249767Z level=info msg="Migration successfully executed" id="admin only folder/dashboard permission" duration=1.041247ms 2024-09-06T15:14:55.528 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.536162841Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-06T15:14:55.847 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:14:55 smithi189 bash[60570]: ts=2024-09-06T15:14:55.313Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000971805s 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.553287722Z level=info msg="Migration successfully executed" id="add action column to seed_assignment" duration=17.124567ms 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.620814571Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.635168465Z level=info msg="Migration successfully executed" id="add scope column to seed_assignment" duration=14.352154ms 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.696754908Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.698265282Z level=info msg="Migration successfully executed" id="remove unique index builtin_role_role_name before nullable update" duration=1.513984ms 2024-09-06T15:14:55.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.772125725Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-06T15:14:55.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986239 got 133143986241 for osd.4 2024-09-06T15:14:55.945 DEBUG:teuthology.parallel:result is None 2024-09-06T15:14:56.145 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738474 got 34359738476 for osd.0 2024-09-06T15:14:56.145 DEBUG:teuthology.parallel:result is None 2024-09-06T15:14:56.198 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:55.888524066Z level=info msg="Migration successfully executed" id="update seed_assignment role_name column to nullable" duration=116.404355ms 2024-09-06T15:14:56.198 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.052171402Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-06T15:14:56.199 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.053912506Z level=info msg="Migration successfully executed" id="add unique index builtin_role_name back" duration=1.743454ms 2024-09-06T15:14:56.199 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[24979]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.199 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:55 smithi190 bash[24979]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:55 smithi189 bash[22757]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:55 smithi189 bash[22757]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:55 smithi189 bash[29727]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:55 smithi189 bash[29727]: cluster 2024-09-06T15:14:55.815744+0000 mgr.y (mgr.14631) 71 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:14:56.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.537+0000 7fb4213b1640 1 -- 172.21.15.189:0/632018501 >> v1:172.21.15.189:6789/0 conn(0x7fb41c1156b0 legacy=0x7fb41c117aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.537+0000 7fb4213b1640 1 -- 172.21.15.189:0/632018501 shutdown_connections 2024-09-06T15:14:56.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.537+0000 7fb4213b1640 1 -- 172.21.15.189:0/632018501 >> 172.21.15.189:0/632018501 conn(0x7fb41c100520 msgr2=0x7fb41c102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:56.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.537+0000 7fb4213b1640 1 -- 172.21.15.189:0/632018501 shutdown_connections 2024-09-06T15:14:56.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.537+0000 7fb4213b1640 1 -- 172.21.15.189:0/632018501 wait complete. 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 Processor -- start 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- start start 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb41c1adb40 con 0x7fb41c077f20 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb41c1aed40 con 0x7fb41c1156b0 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb41c1aff40 con 0x7fb41c077430 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb41affd640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fb41c077430 0x7fb41c114d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44676/0 (socket says 172.21.15.189:44676) 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb41affd640 1 -- 172.21.15.189:0/2518673200 learned_addr learned my addr 172.21.15.189:0/2518673200 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:56.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128575069 0 0) 0x7fb41c1adb40 con 0x7fb41c077f20 2024-09-06T15:14:56.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb404003520 con 0x7fb41c077f20 2024-09-06T15:14:56.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974810168 0 0) 0x7fb41c1aff40 con 0x7fb41c077430 2024-09-06T15:14:56.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c1adb40 con 0x7fb41c077430 2024-09-06T15:14:56.537 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3489611862 0 0) 0x7fb404003520 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb41c1aff40 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb40c0018b0 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1240909478 0 0) 0x7fb41c1adb40 con 0x7fb41c077430 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb404003520 con 0x7fb41c077430 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb410001310 con 0x7fb41c077430 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381377019 0 0) 0x7fb41c1aed40 con 0x7fb41c1156b0 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c1adb40 con 0x7fb41c1156b0 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1795751053 0 0) 0x7fb41c1aff40 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 >> v1:172.21.15.189:6790/0 conn(0x7fb41c077430 legacy=0x7fb41c114d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 >> v1:172.21.15.190:6789/0 conn(0x7fb41c1156b0 legacy=0x7fb41c1ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c1b11e0 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c1b0170 con 0x7fb41c077f20 2024-09-06T15:14:56.538 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fb40c003a60 con 0x7fb41c077f20 2024-09-06T15:14:56.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb40c0049c0 con 0x7fb41c077f20 2024-09-06T15:14:56.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb41c1b0750 con 0x7fb41c077f20 2024-09-06T15:14:56.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41c078940 con 0x7fb41c077f20 2024-09-06T15:14:56.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fb40c0035f0 con 0x7fb41c077f20 2024-09-06T15:14:56.539 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.541+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fb40c093c90 con 0x7fb41c077f20 2024-09-06T15:14:56.543 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.545+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fb40c05cc10 con 0x7fb41c077f20 2024-09-06T15:14:56.563 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.207494106Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-06T15:14:56.564 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.210009951Z level=info msg="Migration successfully executed" id="add unique index builtin_role_action_scope" duration=2.514842ms 2024-09-06T15:14:56.564 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.29204549Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-06T15:14:56.564 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.344074527Z level=info msg="Migration successfully executed" id="add primary key to seed_assigment" duration=52.030563ms 2024-09-06T15:14:56.564 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.572971673Z level=info msg="Executing migration" id="add origin column to seed_assignment" 2024-09-06T15:14:56.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb41c11b390 con 0x7fb41c077f20 2024-09-06T15:14:56.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb403fff640 1 -- 172.21.15.189:0/2518673200 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (unknown 2131975755 0 2288206851) 0x7fb40c060d80 con 0x7fb41c077f20 2024-09-06T15:14:56.709 INFO:teuthology.orchestra.run.smithi189.stdout:158913790006 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 >> v1:172.21.15.189:6800/1420554776 conn(0x7fb404078510 legacy=0x7fb40407a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 >> v1:172.21.15.189:6789/0 conn(0x7fb41c077f20 legacy=0x7fb41c1a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 shutdown_connections 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 >> 172.21.15.189:0/2518673200 conn(0x7fb41c100520 msgr2=0x7fb41c117aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 shutdown_connections 2024-09-06T15:14:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.713+0000 7fb4213b1640 1 -- 172.21.15.189:0/2518673200 wait complete. 2024-09-06T15:14:56.846 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.589085217Z level=info msg="Migration successfully executed" id="add origin column to seed_assignment" duration=16.113633ms 2024-09-06T15:14:56.846 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.785551758Z level=info msg="Executing migration" id="add origin to plugin seed_assignment" 2024-09-06T15:14:56.846 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.786419713Z level=info msg="Migration successfully executed" id="add origin to plugin seed_assignment" duration=862.272µs 2024-09-06T15:14:56.846 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.85550991Z level=info msg="Executing migration" id="prevent seeding OnCall access" 2024-09-06T15:14:56.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- 172.21.15.189:0/1953299983 >> v1:172.21.15.189:6789/0 conn(0x7ff9881017d0 legacy=0x7ff988101bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- 172.21.15.189:0/1953299983 shutdown_connections 2024-09-06T15:14:56.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- 172.21.15.189:0/1953299983 >> 172.21.15.189:0/1953299983 conn(0x7ff9880fd240 msgr2=0x7ff9880ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:56.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- 172.21.15.189:0/1953299983 shutdown_connections 2024-09-06T15:14:56.914 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- 172.21.15.189:0/1953299983 wait complete. 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 Processor -- start 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- start start 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff9881a54b0 con 0x7ff98810dee0 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff9881a66b0 con 0x7ff98810a340 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98eb33640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ff9881a78b0 con 0x7ff9881017d0 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98d0d0640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ff98810dee0 0x7ff9881a3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40416/0 (socket says 172.21.15.189:40416) 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff98d0d0640 1 -- 172.21.15.189:0/1570781134 learned_addr learned my addr 172.21.15.189:0/1570781134 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:56.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.917+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870813173 0 0) 0x7ff9881a54b0 con 0x7ff98810dee0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff978003520 con 0x7ff98810dee0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123614221 0 0) 0x7ff9881a78b0 con 0x7ff9881017d0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9881a54b0 con 0x7ff9881017d0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3420028850 0 0) 0x7ff978003520 con 0x7ff98810dee0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9881a78b0 con 0x7ff98810dee0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff980001cd0 con 0x7ff98810dee0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2048763131 0 0) 0x7ff9881a54b0 con 0x7ff9881017d0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff978003520 con 0x7ff9881017d0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff97c001a70 con 0x7ff9881017d0 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058570606 0 0) 0x7ff9881a66b0 con 0x7ff98810a340 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9881a54b0 con 0x7ff98810a340 2024-09-06T15:14:56.917 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3987953262 0 0) 0x7ff9881a78b0 con 0x7ff98810dee0 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 >> v1:172.21.15.189:6790/0 conn(0x7ff9881017d0 legacy=0x7ff98810d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 >> v1:172.21.15.190:6789/0 conn(0x7ff98810a340 legacy=0x7ff9881a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9881a8b50 con 0x7ff98810dee0 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9881a7ae0 con 0x7ff98810dee0 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9881a80c0 con 0x7ff98810dee0 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7ff980003e00 con 0x7ff98810dee0 2024-09-06T15:14:56.918 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ff980005ea0 con 0x7ff98810dee0 2024-09-06T15:14:56.919 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff96c005080 con 0x7ff98810dee0 2024-09-06T15:14:56.919 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7ff980003990 con 0x7ff98810dee0 2024-09-06T15:14:56.919 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.921+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7ff980094f20 con 0x7ff98810dee0 2024-09-06T15:14:56.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:56.925+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ff98005dea0 con 0x7ff98810dee0 2024-09-06T15:14:57.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.093+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff96c005370 con 0x7ff98810dee0 2024-09-06T15:14:57.090 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.093+0000 7ff985ffb640 1 -- 172.21.15.189:0/1570781134 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (unknown 383520633 0 4272388924) 0x7ff980062010 con 0x7ff98810dee0 2024-09-06T15:14:57.090 INFO:teuthology.orchestra.run.smithi189.stdout:111669149771 2024-09-06T15:14:57.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 >> v1:172.21.15.189:6800/1420554776 conn(0x7ff9780783f0 legacy=0x7ff97807a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 >> v1:172.21.15.189:6789/0 conn(0x7ff98810dee0 legacy=0x7ff9881a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 shutdown_connections 2024-09-06T15:14:57.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 >> 172.21.15.189:0/1570781134 conn(0x7ff9880fd240 msgr2=0x7ff988110b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:57.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 shutdown_connections 2024-09-06T15:14:57.093 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.097+0000 7ff98eb33640 1 -- 172.21.15.189:0/1570781134 wait complete. 2024-09-06T15:14:57.093 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:56 smithi189 bash[22757]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.093 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:56 smithi189 bash[22757]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:56 smithi189 bash[29727]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:56 smithi189 bash[29727]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[24979]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[24979]: audit 2024-09-06T15:14:56.715998+0000 mon.a (mon.0) 840 : audit [DBG] from='client.? v1:172.21.15.189:0/2518673200' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-06T15:14:57.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.855961936Z level=info msg="Migration successfully executed" id="prevent seeding OnCall access" duration=451.235µs 2024-09-06T15:14:57.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.930438678Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-06T15:14:57.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:56 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:56.931061259Z level=info msg="Migration successfully executed" id="managed folder permissions alert actions repeated fixed migration" duration=625.747µs 2024-09-06T15:14:57.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.013815013Z level=info msg="Executing migration" id="managed folder permissions library panel actions migration" 2024-09-06T15:14:57.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.014366805Z level=info msg="Migration successfully executed" id="managed folder permissions library panel actions migration" duration=551.545µs 2024-09-06T15:14:57.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.104224866Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-06T15:14:57.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.104828367Z level=info msg="Migration successfully executed" id="migrate external alertmanagers to datsourcse" duration=613.817µs 2024-09-06T15:14:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/4093134726 >> v1:172.21.15.189:6789/0 conn(0x7f55f410a330 legacy=0x7f55f410c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/4093134726 shutdown_connections 2024-09-06T15:14:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/4093134726 >> 172.21.15.189:0/4093134726 conn(0x7f55f40fd210 msgr2=0x7f55f40ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/4093134726 shutdown_connections 2024-09-06T15:14:57.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/4093134726 wait complete. 2024-09-06T15:14:57.198 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 Processor -- start 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- start start 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f55f41a7630 con 0x7f55f41017c0 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f55f41a8830 con 0x7f55f410ded0 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f55f41a9a30 con 0x7f55f410a330 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fa3df640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f55f41017c0 0x7f55f410d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40432/0 (socket says 172.21.15.189:40432) 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fa3df640 1 -- 172.21.15.189:0/2871666451 learned_addr learned my addr 172.21.15.189:0/2871666451 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015689589 0 0) 0x7f55f41a7630 con 0x7f55f41017c0 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55e0003520 con 0x7f55f41017c0 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517296415 0 0) 0x7f55f41a9a30 con 0x7f55f410a330 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f41a7630 con 0x7f55f410a330 2024-09-06T15:14:57.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2625521302 0 0) 0x7f55e0003520 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55f41a9a30 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f55ec0018f0 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3864840121 0 0) 0x7f55f41a7630 con 0x7f55f410a330 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55e0003520 con 0x7f55f410a330 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f55e4001650 con 0x7f55f410a330 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3807809604 0 0) 0x7f55f41a9a30 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 >> v1:172.21.15.189:6790/0 conn(0x7f55f410a330 legacy=0x7f55f41a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 >> v1:172.21.15.190:6789/0 conn(0x7f55f410ded0 legacy=0x7f55f41a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f41aacd0 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55f41a9c60 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f55f41aa290 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f55ec003a80 con 0x7f55f41017c0 2024-09-06T15:14:57.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.201+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f55ec005c00 con 0x7f55f41017c0 2024-09-06T15:14:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.205+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d8005080 con 0x7f55f41017c0 2024-09-06T15:14:57.201 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.205+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f55ec003610 con 0x7f55f41017c0 2024-09-06T15:14:57.202 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.205+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f55ec094d30 con 0x7f55f41017c0 2024-09-06T15:14:57.204 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.209+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f55ec05dcb0 con 0x7f55f41017c0 2024-09-06T15:14:57.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.373+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f55d8005370 con 0x7f55f41017c0 2024-09-06T15:14:57.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.373+0000 7f55eb7fe640 1 -- 172.21.15.189:0/2871666451 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (unknown 1274345170 0 3258275067) 0x7f55ec061e20 con 0x7f55f41017c0 2024-09-06T15:14:57.371 INFO:teuthology.orchestra.run.smithi189.stdout:184683593772 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 >> v1:172.21.15.189:6800/1420554776 conn(0x7f55e0078280 legacy=0x7f55e007a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 >> v1:172.21.15.189:6789/0 conn(0x7f55f41017c0 legacy=0x7f55f410d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 shutdown_connections 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 >> 172.21.15.189:0/2871666451 conn(0x7f55f40fd210 msgr2=0x7f55f4100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 shutdown_connections 2024-09-06T15:14:57.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.377+0000 7f55fc643640 1 -- 172.21.15.189:0/2871666451 wait complete. 2024-09-06T15:14:57.441 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.441+0000 7f3616810640 1 -- 172.21.15.189:0/299448704 >> v1:172.21.15.189:6790/0 conn(0x7f36101119e0 legacy=0x7f3610113dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.441+0000 7f3616810640 1 -- 172.21.15.189:0/299448704 shutdown_connections 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.441+0000 7f3616810640 1 -- 172.21.15.189:0/299448704 >> 172.21.15.189:0/299448704 conn(0x7f3610078560 msgr2=0x7f361007a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.441+0000 7f3616810640 1 -- 172.21.15.189:0/299448704 shutdown_connections 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.441+0000 7f3616810640 1 -- 172.21.15.189:0/299448704 wait complete. 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 Processor -- start 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- start start 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f3610115270 con 0x7f3610108fa0 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f36101af190 con 0x7f36101155e0 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f36101b0370 con 0x7f36101119e0 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3607fff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f36101119e0 0x7f36101129e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44736/0 (socket says 172.21.15.189:44736) 2024-09-06T15:14:57.442 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3607fff640 1 -- 172.21.15.189:0/3578474925 learned_addr learned my addr 172.21.15.189:0/3578474925 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676333656 0 0) 0x7f36101b0370 con 0x7f36101119e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35fc003520 con 0x7f36101119e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364847061 0 0) 0x7f3610115270 con 0x7f3610108fa0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36101b0370 con 0x7f3610108fa0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3073758525 0 0) 0x7f35fc003520 con 0x7f36101119e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3610115270 con 0x7f36101119e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f35f8001a70 con 0x7f36101119e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268148290 0 0) 0x7f36101af190 con 0x7f36101155e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35fc003520 con 0x7f36101155e0 2024-09-06T15:14:57.443 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3805226023 0 0) 0x7f36101b0370 con 0x7f3610108fa0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36101af190 con 0x7f3610108fa0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f3600001930 con 0x7f3610108fa0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2618374999 0 0) 0x7f3610115270 con 0x7f36101119e0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 >> v1:172.21.15.190:6789/0 conn(0x7f36101155e0 legacy=0x7f36101aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 >> v1:172.21.15.189:6789/0 conn(0x7f3610108fa0 legacy=0x7f36101122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101b1550 con 0x7f36101119e0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36101ae1e0 con 0x7f36101119e0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f36101ae790 con 0x7f36101119e0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f35f8001ca0 con 0x7f36101119e0 2024-09-06T15:14:57.444 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f35f8004ba0 con 0x7f36101119e0 2024-09-06T15:14:57.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f00050b0 con 0x7f36101119e0 2024-09-06T15:14:57.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f35f8003770 con 0x7f36101119e0 2024-09-06T15:14:57.445 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.445+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f35f8094d70 con 0x7f36101119e0 2024-09-06T15:14:57.447 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.449+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f35f805dcf0 con 0x7f36101119e0 2024-09-06T15:14:57.481 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.204771882Z level=info msg="Executing migration" id="create folder table" 2024-09-06T15:14:57.481 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.207464309Z level=info msg="Migration successfully executed" id="create folder table" duration=2.693641ms 2024-09-06T15:14:57.481 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.246733378Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.248075109Z level=info msg="Migration successfully executed" id="Add index for parent_uid" duration=1.353104ms 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.289152743Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.290336252Z level=info msg="Migration successfully executed" id="Add unique index for folder.uid and folder.org_id" duration=1.184719ms 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.331005082Z level=info msg="Executing migration" id="Update folder title length" 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.331051947Z level=info msg="Migration successfully executed" id="Update folder title length" duration=44.735µs 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.398329251Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.399514544Z level=info msg="Migration successfully executed" id="Add unique index for folder.title and folder.parent_uid" duration=1.188083ms 2024-09-06T15:14:57.482 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.490541984Z level=info msg="Executing migration" id="Remove unique index for folder.title and folder.parent_uid" 2024-09-06T15:14:57.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.609+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f35f00053a0 con 0x7f36101119e0 2024-09-06T15:14:57.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.609+0000 7f360dffb640 1 -- 172.21.15.189:0/3578474925 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (unknown 1482059429 0 2461996645) 0x7f35f8061e60 con 0x7f36101119e0 2024-09-06T15:14:57.606 INFO:teuthology.orchestra.run.smithi189.stdout:210453397537 2024-09-06T15:14:57.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 >> v1:172.21.15.189:6800/1420554776 conn(0x7f35fc078410 legacy=0x7f35fc07a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 >> v1:172.21.15.189:6790/0 conn(0x7f36101119e0 legacy=0x7f36101129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:57.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 shutdown_connections 2024-09-06T15:14:57.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 >> 172.21.15.189:0/3578474925 conn(0x7f3610078560 msgr2=0x7f3610118250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:57.609 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 shutdown_connections 2024-09-06T15:14:57.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:57.613+0000 7f3616810640 1 -- 172.21.15.189:0/3578474925 wait complete. 2024-09-06T15:14:57.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.491705219Z level=info msg="Migration successfully executed" id="Remove unique index for folder.title and folder.parent_uid" duration=1.155948ms 2024-09-06T15:14:57.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.574263029Z level=info msg="Executing migration" id="Add unique index for title, parent_uid, and org_id" 2024-09-06T15:14:57.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.576868098Z level=info msg="Migration successfully executed" id="Add unique index for title, parent_uid, and org_id" duration=2.605875ms 2024-09-06T15:14:57.762 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.771351946Z level=info msg="Executing migration" id="Sync dashboard and folder table" 2024-09-06T15:14:58.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.772517881Z level=info msg="Migration successfully executed" id="Sync dashboard and folder table" duration=1.166379ms 2024-09-06T15:14:58.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.976922332Z level=info msg="Executing migration" id="Remove ghost folders from the folder table" 2024-09-06T15:14:58.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:57.977669501Z level=info msg="Migration successfully executed" id="Remove ghost folders from the folder table" duration=748.213µs 2024-09-06T15:14:58.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.122 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:57 smithi190 bash[24979]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.153+0000 7f93b63f9640 1 -- 172.21.15.189:0/3591649913 >> v1:172.21.15.189:6790/0 conn(0x7f93b0104ad0 legacy=0x7f93b0104eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.151 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.153+0000 7f93b63f9640 1 -- 172.21.15.189:0/3591649913 shutdown_connections 2024-09-06T15:14:58.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.153+0000 7f93b63f9640 1 -- 172.21.15.189:0/3591649913 >> 172.21.15.189:0/3591649913 conn(0x7f93b0100520 msgr2=0x7f93b0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:58.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.153+0000 7f93b63f9640 1 -- 172.21.15.189:0/3591649913 shutdown_connections 2024-09-06T15:14:58.152 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- 172.21.15.189:0/3591649913 wait complete. 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 Processor -- start 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- start start 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f93b01a96e0 con 0x7f93b0104ad0 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f93b01aa8e0 con 0x7f93b010d640 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f93b01abae0 con 0x7f93b01111e0 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b4996640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f93b01111e0 0x7f93b01a7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44762/0 (socket says 172.21.15.189:44762) 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b4996640 1 -- 172.21.15.189:0/409087326 learned_addr learned my addr 172.21.15.189:0/409087326 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93affff640 1 --1- 172.21.15.189:0/409087326 >> v1:172.21.15.189:6789/0 conn(0x7f93b0104ad0 0x7f93b0110850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40470/0 (socket says 172.21.15.189:40470) 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000935533 0 0) 0x7f93b01abae0 con 0x7f93b01111e0 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9398003160 con 0x7f93b01111e0 2024-09-06T15:14:58.153 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138797335 0 0) 0x7f93b01a96e0 con 0x7f93b0104ad0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b01abae0 con 0x7f93b0104ad0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3686661198 0 0) 0x7f9398003160 con 0x7f93b01111e0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93b01a96e0 con 0x7f93b01111e0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f93a8001b70 con 0x7f93b01111e0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989178992 0 0) 0x7f93b01aa8e0 con 0x7f93b010d640 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9398003160 con 0x7f93b010d640 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3351233218 0 0) 0x7f93b01abae0 con 0x7f93b0104ad0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93b01aa8e0 con 0x7f93b0104ad0 2024-09-06T15:14:58.154 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f93a4001630 con 0x7f93b0104ad0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3208758667 0 0) 0x7f93b01a96e0 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 >> v1:172.21.15.190:6789/0 conn(0x7f93b010d640 legacy=0x7f93b01a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 >> v1:172.21.15.189:6789/0 conn(0x7f93b0104ad0 legacy=0x7f93b0110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b01acd80 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93b01a9910 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f93b01a9ec0 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f93a8002080 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f93a8005e80 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c0050b0 con 0x7f93b01111e0 2024-09-06T15:14:58.155 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.157+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f93a8003970 con 0x7f93b01111e0 2024-09-06T15:14:58.156 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.161+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f93a8094f80 con 0x7f93b01111e0 2024-09-06T15:14:58.159 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.165+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f93a805df00 con 0x7f93b01111e0 2024-09-06T15:14:58.325 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f939c0053a0 con 0x7f93b01111e0 2024-09-06T15:14:58.325 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93ad7fa640 1 -- 172.21.15.189:0/409087326 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1648722381) 0x7f93a8062070 con 0x7f93b01111e0 2024-09-06T15:14:58.325 INFO:teuthology.orchestra.run.smithi189.stdout:77309411415 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 >> v1:172.21.15.189:6800/1420554776 conn(0x7f93980783d0 legacy=0x7f939807a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 >> v1:172.21.15.189:6790/0 conn(0x7f93b01111e0 legacy=0x7f93b01a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 shutdown_connections 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 >> 172.21.15.189:0/409087326 conn(0x7f93b0100520 msgr2=0x7f93b01082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.329+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 shutdown_connections 2024-09-06T15:14:58.327 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.333+0000 7f93b63f9640 1 -- 172.21.15.189:0/409087326 wait complete. 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[29727]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.338 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.096899+0000 mon.a (mon.0) 841 : audit [DBG] from='client.? v1:172.21.15.189:0/1570781134' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.378247+0000 mon.a (mon.0) 842 : audit [DBG] from='client.? v1:172.21.15.189:0/2871666451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: audit 2024-09-06T15:14:57.612513+0000 mon.c (mon.2) 67 : audit [DBG] from='client.? v1:172.21.15.189:0/3578474925' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.339 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:57 smithi189 bash[22757]: cluster 2024-09-06T15:14:57.816522+0000 mgr.y (mgr.14631) 72 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.202263792Z level=info msg="Executing migration" id="Remove unique index UQE_folder_uid_org_id" 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.204597669Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_uid_org_id" duration=2.334844ms 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.368840674Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_uid" 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.371190637Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_uid" duration=2.348937ms 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.444546374Z level=info msg="Executing migration" id="Remove unique index UQE_folder_title_parent_uid_org_id" 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.447035407Z level=info msg="Migration successfully executed" id="Remove unique index UQE_folder_title_parent_uid_org_id" duration=2.496616ms 2024-09-06T15:14:58.520 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.528983647Z level=info msg="Executing migration" id="Add unique index UQE_folder_org_id_parent_uid_title" 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.531887716Z level=info msg="Migration successfully executed" id="Add unique index UQE_folder_org_id_parent_uid_title" duration=2.905588ms 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.570817501Z level=info msg="Executing migration" id="Remove index IDX_folder_parent_uid_org_id" 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.571977885Z level=info msg="Migration successfully executed" id="Remove index IDX_folder_parent_uid_org_id" duration=1.162831ms 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.612869841Z level=info msg="Executing migration" id="create anon_device table" 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.613853318Z level=info msg="Migration successfully executed" id="create anon_device table" duration=985.315µs 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.697047548Z level=info msg="Executing migration" id="add unique index anon_device.device_id" 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.699753812Z level=info msg="Migration successfully executed" id="add unique index anon_device.device_id" duration=2.709818ms 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.76392675Z level=info msg="Executing migration" id="add index anon_device.updated_at" 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.765206733Z level=info msg="Migration successfully executed" id="add index anon_device.updated_at" duration=1.282369ms 2024-09-06T15:14:58.780 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.789302474Z level=info msg="Executing migration" id="create signing_key table" 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 systemd[1]: Stopping Ceph prometheus.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.727Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-06T15:14:58.781 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.728Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-06T15:14:58.782 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.728Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-06T15:14:58.782 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.728Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-06T15:14:58.782 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[50528]: ts=2024-09-06T15:14:58.728Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-06T15:14:58.786 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- 172.21.15.189:0/3961599461 >> v1:172.21.15.189:6789/0 conn(0x7f617010f110 legacy=0x7f6170111500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.786 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- 172.21.15.189:0/3961599461 shutdown_connections 2024-09-06T15:14:58.786 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- 172.21.15.189:0/3961599461 >> 172.21.15.189:0/3961599461 conn(0x7f61700fd250 msgr2=0x7f61700ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:58.786 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- 172.21.15.189:0/3961599461 shutdown_connections 2024-09-06T15:14:58.786 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- 172.21.15.189:0/3961599461 wait complete. 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 Processor -- start 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- start start 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61701a75a0 con 0x7f61701037f0 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61701a87a0 con 0x7f617010b600 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f6175f6f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61701a99a0 con 0x7f617010f110 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f616ffff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f617010f110 0x7f61701a5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:47434/0 (socket says 172.21.15.189:47434) 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f616ffff640 1 -- 172.21.15.189:0/1771494541 learned_addr learned my addr 172.21.15.189:0/1771494541 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:14:58.787 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.789+0000 7f616f7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f61701037f0 0x7f617010acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:41022/0 (socket says 172.21.15.189:41022) 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649298807 0 0) 0x7f61701a75a0 con 0x7f61701037f0 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6158004920 con 0x7f61701037f0 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075092238 0 0) 0x7f61701a99a0 con 0x7f617010f110 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61701a75a0 con 0x7f617010f110 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631705966 0 0) 0x7f61701a87a0 con 0x7f617010b600 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61701a99a0 con 0x7f617010b600 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3711580105 0 0) 0x7f6158004920 con 0x7f61701037f0 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61701a87a0 con 0x7f61701037f0 2024-09-06T15:14:58.789 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6160001970 con 0x7f61701037f0 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 994293265 0 0) 0x7f61701a75a0 con 0x7f617010f110 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6158004920 con 0x7f617010f110 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2009507277 0 0) 0x7f61701a99a0 con 0x7f617010b600 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61701a75a0 con 0x7f617010b600 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6168001730 con 0x7f617010f110 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6164001210 con 0x7f617010b600 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 76176672 0 0) 0x7f61701a87a0 con 0x7f61701037f0 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 >> v1:172.21.15.189:6790/0 conn(0x7f617010f110 legacy=0x7f61701a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 >> v1:172.21.15.190:6789/0 conn(0x7f617010b600 legacy=0x7f61701a2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61701aac40 con 0x7f61701037f0 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61701a9bd0 con 0x7f61701037f0 2024-09-06T15:14:58.790 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f61701aa1b0 con 0x7f61701037f0 2024-09-06T15:14:58.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f6160001c70 con 0x7f61701037f0 2024-09-06T15:14:58.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f6160005c90 con 0x7f61701037f0 2024-09-06T15:14:58.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c0050b0 con 0x7f61701037f0 2024-09-06T15:14:58.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f61600038c0 con 0x7f61701037f0 2024-09-06T15:14:58.791 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.793+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f6160094bb0 con 0x7f61701037f0 2024-09-06T15:14:58.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.797+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f616005db30 con 0x7f61701037f0 2024-09-06T15:14:58.955 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.957+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f615c0053a0 con 0x7f61701037f0 2024-09-06T15:14:58.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f616cff9640 1 -- 172.21.15.189:0/1771494541 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 2158320199) 0x7f6160061ca0 con 0x7f61701037f0 2024-09-06T15:14:58.956 INFO:teuthology.orchestra.run.smithi189.stdout:55834574946 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 >> v1:172.21.15.189:6800/1420554776 conn(0x7f61580783f0 legacy=0x7f615807a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 >> v1:172.21.15.189:6789/0 conn(0x7f61701037f0 legacy=0x7f617010acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 shutdown_connections 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 >> 172.21.15.189:0/1771494541 conn(0x7f61700fd250 msgr2=0x7f61700ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 shutdown_connections 2024-09-06T15:14:58.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:14:58.961+0000 7f6175f6f640 1 -- 172.21.15.189:0/1771494541 wait complete. 2024-09-06T15:14:59.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[24979]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[24979]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.790422736Z level=info msg="Migration successfully executed" id="create signing_key table" duration=1.1205ms 2024-09-06T15:14:59.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.848344814Z level=info msg="Executing migration" id="add unique index signing_key.key_id" 2024-09-06T15:14:59.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.849462615Z level=info msg="Migration successfully executed" id="add unique index signing_key.key_id" duration=1.121849ms 2024-09-06T15:14:59.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.92352582Z level=info msg="Executing migration" id="set legacy alert migration status in kvstore" 2024-09-06T15:14:59.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.926099622Z level=info msg="Migration successfully executed" id="set legacy alert migration status in kvstore" duration=2.583139ms 2024-09-06T15:14:59.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:58 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.998937673Z level=info msg="Executing migration" id="migrate record of created folders during legacy migration to kvstore" 2024-09-06T15:14:59.122 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:58.999848054Z level=info msg="Migration successfully executed" id="migrate record of created folders during legacy migration to kvstore" duration=912.748µs 2024-09-06T15:14:59.165 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:58 smithi189 bash[22757]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.165 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:58 smithi189 bash[22757]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:58 smithi189 bash[29727]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:58 smithi189 bash[29727]: audit 2024-09-06T15:14:58.331899+0000 mon.c (mon.2) 68 : audit [DBG] from='client.? v1:172.21.15.189:0/409087326' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-06T15:14:59.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790006 for osd.5 2024-09-06T15:14:59.587 DEBUG:teuthology.parallel:result is None 2024-09-06T15:14:59.602 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.241464778Z level=info msg="Executing migration" id="Add folder_uid for dashboard" 2024-09-06T15:14:59.602 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.259221956Z level=info msg="Migration successfully executed" id="Add folder_uid for dashboard" duration=17.757344ms 2024-09-06T15:14:59.850 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149768 got 111669149771 for osd.3 2024-09-06T15:14:59.850 DEBUG:teuthology.parallel:result is None 2024-09-06T15:14:59.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593770 got 184683593772 for osd.6 2024-09-06T15:14:59.851 DEBUG:teuthology.parallel:result is None 2024-09-06T15:14:59.871 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[52357]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-prometheus-a 2024-09-06T15:14:59.871 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[52419]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-prometheus-a 2024-09-06T15:14:59.871 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:59 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-09-06T15:14:59.871 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:59 smithi190 systemd[1]: Stopped Ceph prometheus.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:59.871 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:14:59 smithi190 systemd[1]: Started Ceph prometheus.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.612273025Z level=info msg="Executing migration" id="Populate dashboard folder_uid column" 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.613964918Z level=info msg="Migration successfully executed" id="Populate dashboard folder_uid column" duration=1.695421ms 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.767924981Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title" 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.77066588Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title" duration=2.739818ms 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.835684798Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_id_title" 2024-09-06T15:14:59.871 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.837824407Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_id_title" duration=2.147791ms 2024-09-06T15:14:59.872 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.852924854Z level=info msg="Executing migration" id="Delete unique index for dashboard_org_id_folder_uid_title" 2024-09-06T15:14:59.872 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.854106921Z level=info msg="Migration successfully executed" id="Delete unique index for dashboard_org_id_folder_uid_title" duration=1.18463ms 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[22757]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.226 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[23007]: [06/Sep/2024:15:14:59] ENGINE Bus STOPPING 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:14:59 smithi189 bash[29727]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.886520182Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.887792108Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_folder_uid_title_is_folder" duration=1.272843ms 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.928924134Z level=info msg="Executing migration" id="Restore index for dashboard_org_id_folder_id_title" 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:14:59.930051643Z level=info msg="Migration successfully executed" id="Restore index for dashboard_org_id_folder_id_title" duration=1.130134ms 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.050725381Z level=info msg="Executing migration" id="create sso_setting table" 2024-09-06T15:15:00.346 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.053158708Z level=info msg="Migration successfully executed" id="create sso_setting table" duration=2.429727ms 2024-09-06T15:15:00.346 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: audit 2024-09-06T15:14:58.962777+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? v1:172.21.15.189:0/1771494541' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-06T15:15:00.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: cluster 2024-09-06T15:14:59.817387+0000 mgr.y (mgr.14631) 73 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-06T15:15:00.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.347 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:14:59 smithi190 bash[24979]: audit 2024-09-06T15:14:59.910216+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:00.497 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-06T15:15:00.497 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STOPPED 2024-09-06T15:15:00.497 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STARTING 2024-09-06T15:15:00.497 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Serving on http://:::9283 2024-09-06T15:15:00.498 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STARTED 2024-09-06T15:15:00.498 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STOPPING 2024-09-06T15:15:00.499 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397534 got 210453397537 for osd.7 2024-09-06T15:15:00.499 DEBUG:teuthology.parallel:result is None 2024-09-06T15:15:00.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.352385639Z level=info msg="Executing migration" id="copy kvstore migration status to each org" 2024-09-06T15:15:00.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.354077895Z level=info msg="Migration successfully executed" id="copy kvstore migration status to each org" duration=1.6977ms 2024-09-06T15:15:00.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.604375638Z level=info msg="Executing migration" id="add back entry for orgid=0 migrated status" 2024-09-06T15:15:00.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.605127658Z level=info msg="Migration successfully executed" id="add back entry for orgid=0 migrated status" duration=755.123µs 2024-09-06T15:15:00.865 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411412 got 77309411415 for osd.2 2024-09-06T15:15:00.865 DEBUG:teuthology.parallel:result is None 2024-09-06T15:15:00.906 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574943 got 55834574946 for osd.1 2024-09-06T15:15:00.906 DEBUG:teuthology.parallel:result is None 2024-09-06T15:15:00.906 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-06T15:15:00.906 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph pg dump --format=json 2024-09-06T15:15:01.069 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.774685412Z level=info msg="Executing migration" id="alter kv_store.value to longtext" 2024-09-06T15:15:01.069 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:00.77489049Z level=info msg="Migration successfully executed" id="alter kv_store.value to longtext" duration=208.315µs 2024-09-06T15:15:01.070 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:01.070 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.070 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.070 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.071 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.072 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.073 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:00 smithi190 bash[24979]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STOPPED 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STARTING 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Serving on http://:::9283 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STARTED 2024-09-06T15:15:01.097 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[23007]: [06/Sep/2024:15:15:00] ENGINE Bus STOPPING 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.922189+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.931142+0000 mon.c (mon.2) 69 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-alertmanager-api-host"} : dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.931772+0000 mgr.y (mgr.14631) 74 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T15:15:01.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.936826+0000 mon.c (mon.2) 70 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"} : dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.937274+0000 mgr.y (mgr.14631) 75 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi189.front.sepia.ceph.com:9093"}]: dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.942638+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.956402+0000 mon.c (mon.2) 71 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.957332+0000 mgr.y (mgr.14631) 76 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T15:15:01.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[22757]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.964297+0000 mon.c (mon.2) 72 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"} : dispatch 2024-09-06T15:15:01.102 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.965219+0000 mgr.y (mgr.14631) 77 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi190.front.sepia.ceph.com:9095"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:14:59.971731+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.035962+0000 mon.c (mon.2) 73 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard get-grafana-api-url"} : dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.036617+0000 mgr.y (mgr.14631) 78 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.040013+0000 mon.c (mon.2) 74 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"} : dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.040601+0000 mgr.y (mgr.14631) 79 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi190.front.sepia.ceph.com:3000"}]: dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.046437+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.233258+0000 mon.c (mon.2) 75 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.234313+0000 mgr.y (mgr.14631) 80 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.350139+0000 mon.c (mon.2) 76 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:00 smithi189 bash[29727]: audit 2024-09-06T15:15:00.848050+0000 mon.c (mon.2) 77 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:01.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.078704853Z level=info msg="Executing migration" id="add notification_settings column to alert_rule table" 2024-09-06T15:15:01.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.095521307Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule table" duration=16.817148ms 2024-09-06T15:15:01.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.254936767Z level=info msg="Executing migration" id="add notification_settings column to alert_rule_version table" 2024-09-06T15:15:01.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.272268039Z level=info msg="Migration successfully executed" id="add notification_settings column to alert_rule_version table" duration=17.332206ms 2024-09-06T15:15:01.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.503046223Z level=info msg="Executing migration" id="removing scope from alert.instances:read action migration" 2024-09-06T15:15:01.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.503822555Z level=info msg="Migration successfully executed" id="removing scope from alert.instances:read action migration" duration=778.358µs 2024-09-06T15:15:01.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=migrator t=2024-09-06T15:15:01.561766815Z level=info msg="migrations completed" performed=547 skipped=0 duration=26.290413929s 2024-09-06T15:15:01.749 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=sqlstore t=2024-09-06T15:15:01.564463846Z level=info msg="Created default organization" 2024-09-06T15:15:01.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=secrets t=2024-09-06T15:15:01.639047477Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-06T15:15:01.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=plugin.store t=2024-09-06T15:15:01.683582147Z level=info msg="Loading plugins..." 2024-09-06T15:15:01.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=local.finder t=2024-09-06T15:15:01.757889289Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-09-06T15:15:01.750 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=plugin.store t=2024-09-06T15:15:01.757938492Z level=info msg="Plugins loaded" count=55 duration=74.35824ms 2024-09-06T15:15:01.847 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[23007]: [06/Sep/2024:15:15:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-06T15:15:01.847 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[23007]: [06/Sep/2024:15:15:01] ENGINE Bus STOPPED 2024-09-06T15:15:01.847 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[23007]: [06/Sep/2024:15:15:01] ENGINE Bus STARTING 2024-09-06T15:15:01.848 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[23007]: [06/Sep/2024:15:15:01] ENGINE Serving on http://:::9283 2024-09-06T15:15:01.848 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[23007]: [06/Sep/2024:15:15:01] ENGINE Bus STARTED 2024-09-06T15:15:02.017 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=query_data t=2024-09-06T15:15:01.764407366Z level=info msg="Query Service initialization" 2024-09-06T15:15:02.017 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=live.push_http t=2024-09-06T15:15:01.771530644Z level=info msg="Live Push Gateway initialization" 2024-09-06T15:15:02.017 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=ngalert.migration t=2024-09-06T15:15:01.846397161Z level=info msg=Starting 2024-09-06T15:15:02.017 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=ngalert.migration t=2024-09-06T15:15:01.847298389Z level=info msg="Applying transition" currentType=Legacy desiredType=UnifiedAlerting cleanOnDowngrade=false cleanOnUpgrade=false 2024-09-06T15:15:02.018 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=ngalert.migration orgID=1 t=2024-09-06T15:15:01.848297795Z level=info msg="Migrating alerts for organisation" 2024-09-06T15:15:02.018 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=ngalert.migration orgID=1 t=2024-09-06T15:15:01.849189295Z level=info msg="Alerts found to migrate" alerts=0 2024-09-06T15:15:02.018 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[51708]: logger=ngalert.migration t=2024-09-06T15:15:01.851265107Z level=info msg="Completed alerting migration" 2024-09-06T15:15:02.018 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.018 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.018 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.019 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[24979]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.962Z caller=main.go:617 level=info msg="Starting Prometheus Server" mode=server version="(version=2.51.0, branch=HEAD, revision=c05c15512acb675e3f6cd662a6727854e93fc024)" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.962Z caller=main.go:622 level=info build_context="(go=go1.22.1, platform=linux/amd64, user=root@b5723e458358, date=20240319-10:54:45, tags=netgo,builtinassets,stringlabels)" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.962Z caller=main.go:623 level=info host_details="(Linux 5.15.0-119-generic #129-Ubuntu SMP Fri Aug 2 19:25:20 UTC 2024 x86_64 smithi190 (none))" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.962Z caller=main.go:624 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.962Z caller=main.go:625 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.964Z caller=web.go:568 level=info component=web msg="Start listening for connections" address=:9095 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.965Z caller=main.go:1129 level=info msg="Starting TSDB ..." 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.966Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.967Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.969Z caller=head.go:616 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.969Z caller=head.go:698 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.041µs 2024-09-06T15:15:02.020 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.969Z caller=head.go:706 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.970Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.970Z caller=head.go:778 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.970Z caller=head.go:815 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=28.27µs wal_replay_duration=862.268µs wbl_replay_duration=129ns total_replay_duration=911.091µs 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.972Z caller=main.go:1150 level=info fs_type=XFS_SUPER_MAGIC 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.972Z caller=main.go:1153 level=info msg="TSDB started" 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.972Z caller=main.go:1335 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.991Z caller=main.go:1372 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.781018ms db_storage=1.391µs remote_storage=1.257µs web_handler=485ns query_engine=722ns scrape=708.764µs scrape_sd=114.289µs notify=13.133µs notify_sd=9.804µs rules=17.53776ms tracing=6.453µs 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.991Z caller=main.go:1114 level=info msg="Server is ready to receive web requests." 2024-09-06T15:15:02.021 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:15:01 smithi190 bash[52448]: ts=2024-09-06T15:15:01.991Z caller=manager.go:163 level=info component="rule manager" msg="Starting rule manager..." 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ngalert.state.manager t=2024-09-06T15:15:02.026771359Z level=info msg="Running in alternative execution of Error/NoData mode" 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=infra.usagestats.collector t=2024-09-06T15:15:02.029582414Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=provisioning.datasources t=2024-09-06T15:15:02.032574061Z level=info msg="inserting datasource from configuration" name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=provisioning.datasources t=2024-09-06T15:15:02.107766065Z level=info msg="inserting datasource from configuration" name=Loki uid=P8E80F9AEF21F6940 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=provisioning.alerting t=2024-09-06T15:15:02.168675011Z level=info msg="starting to provision alerting" 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=provisioning.alerting t=2024-09-06T15:15:02.168704637Z level=info msg="finished to provision alerting" 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ngalert.state.manager t=2024-09-06T15:15:02.168873328Z level=info msg="Warming state cache for startup" 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=grafanaStorageLogger t=2024-09-06T15:15:02.168973877Z level=info msg="Storage starting" 2024-09-06T15:15:02.283 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ngalert.state.manager t=2024-09-06T15:15:02.169865631Z level=info msg="State cache has been initialized" states=0 duration=988.989µs 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ngalert.scheduler t=2024-09-06T15:15:02.16993111Z level=info msg="Starting scheduler" tickInterval=10s maxAttempts=1 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ticker t=2024-09-06T15:15:02.170023256Z level=info msg=starting first_tick=2024-09-06T15:15:10Z 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=ngalert.multiorg.alertmanager t=2024-09-06T15:15:02.170047614Z level=info msg="Starting MultiOrg Alertmanager" 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=http.server t=2024-09-06T15:15:02.174053892Z level=info msg="HTTP Server TLS settings" MinTLSVersion=TLS1.2 configuredciphers=TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA,TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA,TLS_RSA_WITH_AES_128_GCM_SHA256,TLS_RSA_WITH_AES_256_GCM_SHA384,TLS_RSA_WITH_AES_128_CBC_SHA,TLS_RSA_WITH_AES_256_CBC_SHA 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=http.server t=2024-09-06T15:15:02.174301533Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=grafana.update.checker t=2024-09-06T15:15:02.254521212Z level=info msg="Update check succeeded" duration=84.960919ms 2024-09-06T15:15:02.284 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=plugins.update.checker t=2024-09-06T15:15:02.291942922Z level=info msg="Update check succeeded" duration=120.950254ms 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[22757]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:00.846357+0000 mgr.y (mgr.14631) 81 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:00.849110+0000 mgr.y (mgr.14631) 82 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:01.461580+0000 mon.c (mon.2) 78 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: audit 2024-09-06T15:15:01.463383+0000 mgr.y (mgr.14631) 83 : audit [DBG] from='mon.? v1:172.21.15.189:0/75490546' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:01 smithi189 bash[29727]: cluster 2024-09-06T15:15:01.818907+0000 mgr.y (mgr.14631) 84 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:02.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=provisioning.dashboard t=2024-09-06T15:15:02.300320772Z level=info msg="starting to provision dashboards" 2024-09-06T15:15:02.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=sqlstore.transactions t=2024-09-06T15:15:02.352176664Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-06T15:15:02.621 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=sqlstore.transactions t=2024-09-06T15:15:02.363491662Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-06T15:15:03.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=grafana-apiserver t=2024-09-06T15:15:02.764735791Z level=info msg="Adding GroupVersion playlist.grafana.app v0alpha1 to ResourceManager" 2024-09-06T15:15:03.121 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:02 smithi190 bash[51708]: logger=grafana-apiserver t=2024-09-06T15:15:02.765155194Z level=info msg="Adding GroupVersion featuretoggle.grafana.app v0alpha1 to ResourceManager" 2024-09-06T15:15:03.597 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:15:03 smithi189 bash[60570]: ts=2024-09-06T15:15:03.315Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003273206s 2024-09-06T15:15:04.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:03 smithi189 bash[29727]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:04.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:03 smithi189 bash[29727]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:04.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:03 smithi189 bash[22757]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:04.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:03 smithi189 bash[22757]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:04.371 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:15:04 smithi190 bash[51708]: logger=provisioning.dashboard t=2024-09-06T15:15:04.001635797Z level=info msg="finished to provision dashboards" 2024-09-06T15:15:04.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:03 smithi190 bash[24979]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:04.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:03 smithi190 bash[24979]: cluster 2024-09-06T15:15:03.819616+0000 mgr.y (mgr.14631) 85 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:05.490 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:05.579 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:05 smithi189 bash[22757]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:05.579 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:05 smithi189 bash[22757]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:05.580 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:05 smithi189 bash[29727]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:05.580 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:05 smithi189 bash[29727]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:05.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:05 smithi190 bash[24979]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:05.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:05 smithi190 bash[24979]: audit 2024-09-06T15:15:05.281950+0000 mon.c (mon.2) 79 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:06.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[22757]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:06 smithi189 bash[29727]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: cluster 2024-09-06T15:15:05.820343+0000 mgr.y (mgr.14631) 86 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:06.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: audit 2024-09-06T15:15:06.045864+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:06 smithi190 bash[24979]: audit 2024-09-06T15:15:06.051734+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- 172.21.15.189:0/3552501133 >> v1:172.21.15.189:6789/0 conn(0x7f67041028c0 legacy=0x7f6704102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- 172.21.15.189:0/3552501133 shutdown_connections 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- 172.21.15.189:0/3552501133 >> 172.21.15.189:0/3552501133 conn(0x7f67040fe330 msgr2=0x7f6704100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- 172.21.15.189:0/3552501133 shutdown_connections 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- 172.21.15.189:0/3552501133 wait complete. 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 Processor -- start 2024-09-06T15:15:06.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- start start 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f67041a74f0 con 0x7f670410efd0 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f67041a86f0 con 0x7f670410b430 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f670a41c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f67041a98f0 con 0x7f67041028c0 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f6703fff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f67041028c0 0x7f670410e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:47438/0 (socket says 172.21.15.189:47438) 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f6703fff640 1 -- 172.21.15.189:0/1904876070 learned_addr learned my addr 172.21.15.189:0/1904876070 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8254453 0 0) 0x7f67041a98f0 con 0x7f67041028c0 2024-09-06T15:15:06.760 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ec003160 con 0x7f67041028c0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888604688 0 0) 0x7f67041a74f0 con 0x7f670410efd0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67041a98f0 con 0x7f670410efd0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314754479 0 0) 0x7f67041a86f0 con 0x7f670410b430 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67041a74f0 con 0x7f670410b430 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 820402612 0 0) 0x7f66ec003160 con 0x7f67041028c0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67041a86f0 con 0x7f67041028c0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f66f4001630 con 0x7f67041028c0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2829367703 0 0) 0x7f67041a98f0 con 0x7f670410efd0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66ec003160 con 0x7f670410efd0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f66fc001bf0 con 0x7f670410efd0 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3605290818 0 0) 0x7f67041a74f0 con 0x7f670410b430 2024-09-06T15:15:06.761 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.190:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67041a98f0 con 0x7f670410b430 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f66f80011c0 con 0x7f670410b430 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.761+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3533352520 0 0) 0x7f67041a86f0 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 >> v1:172.21.15.190:6789/0 conn(0x7f670410b430 legacy=0x7f67041a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 >> v1:172.21.15.189:6789/0 conn(0x7f670410efd0 legacy=0x7f67041a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67041aab90 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67041a8920 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f67041a8f50 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f66f4001ac0 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f66f4004ce0 con 0x7f67041028c0 2024-09-06T15:15:06.762 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f00050b0 con 0x7f67041028c0 2024-09-06T15:15:06.763 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f66f4003680 con 0x7f67041028c0 2024-09-06T15:15:06.763 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.765+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f66f4094c00 con 0x7f67041028c0 2024-09-06T15:15:06.765 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.769+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f66f405db80 con 0x7f67041028c0 2024-09-06T15:15:06.925 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.929+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 --> v1:172.21.15.189:6800/1420554776 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66f0000bc0 con 0x7f66ec078400 2024-09-06T15:15:06.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.945+0000 7f67017fa640 1 -- 172.21.15.189:0/1904876070 <== mgr.14631 v1:172.21.15.189:6800/1420554776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346473 (unknown 2965378022 0 4098141124) 0x7f66f0000bc0 con 0x7f66ec078400 2024-09-06T15:15:06.946 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:06.948 INFO:teuthology.orchestra.run.smithi189.stderr:dumped all 2024-09-06T15:15:06.949 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 >> v1:172.21.15.189:6800/1420554776 conn(0x7f66ec078400 legacy=0x7f66ec07a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 >> v1:172.21.15.189:6790/0 conn(0x7f67041028c0 legacy=0x7f670410e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 shutdown_connections 2024-09-06T15:15:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 >> 172.21.15.189:0/1904876070 conn(0x7f67040fe330 msgr2=0x7f67041060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 shutdown_connections 2024-09-06T15:15:06.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:06.949+0000 7f670a41c640 1 -- 172.21.15.189:0/1904876070 wait complete. 2024-09-06T15:15:07.650 INFO:teuthology.orchestra.run.smithi189.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-06T15:15:05.819838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":975,"num_read_kb":832,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244152,"kb_used_data":7132,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749717064,"statfs":{"total":767960285184,"available":767710273536,"internally_reserved":0,"allocated":7303168,"data_stored":3849345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005790"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150420+0000","last_change":"2024-09-06T15:13:01.196569+0000","last_active":"2024-09-06T15:13:50.150420+0000","last_peered":"2024-09-06T15:13:50.150420+0000","last_clean":"2024-09-06T15:13:50.150420+0000","last_became_active":"2024-09-06T15:13:01.195798+0000","last_became_peered":"2024-09-06T15:13:01.195798+0000","last_unstale":"2024-09-06T15:13:50.150420+0000","last_undegraded":"2024-09-06T15:13:50.150420+0000","last_fullsized":"2024-09-06T15:13:50.150420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:47:59.276759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229279+0000","last_change":"2024-09-06T15:12:55.093124+0000","last_active":"2024-09-06T15:13:50.229279+0000","last_peered":"2024-09-06T15:13:50.229279+0000","last_clean":"2024-09-06T15:13:50.229279+0000","last_became_active":"2024-09-06T15:12:55.092815+0000","last_became_peered":"2024-09-06T15:12:55.092815+0000","last_unstale":"2024-09-06T15:13:50.229279+0000","last_undegraded":"2024-09-06T15:13:50.229279+0000","last_fullsized":"2024-09-06T15:13:50.229279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:57:32.109121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"60'10","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153103+0000","last_change":"2024-09-06T15:12:57.353450+0000","last_active":"2024-09-06T15:13:50.153103+0000","last_peered":"2024-09-06T15:13:50.153103+0000","last_clean":"2024-09-06T15:13:50.153103+0000","last_became_active":"2024-09-06T15:12:57.353198+0000","last_became_peered":"2024-09-06T15:12:57.353198+0000","last_unstale":"2024-09-06T15:13:50.153103+0000","last_undegraded":"2024-09-06T15:13:50.153103+0000","last_fullsized":"2024-09-06T15:13:50.153103+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:30:34.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771367+0000","last_change":"2024-09-06T15:12:59.108262+0000","last_active":"2024-09-06T15:13:49.771367+0000","last_peered":"2024-09-06T15:13:49.771367+0000","last_clean":"2024-09-06T15:13:49.771367+0000","last_became_active":"2024-09-06T15:12:59.107237+0000","last_became_peered":"2024-09-06T15:12:59.107237+0000","last_unstale":"2024-09-06T15:13:49.771367+0000","last_undegraded":"2024-09-06T15:13:49.771367+0000","last_fullsized":"2024-09-06T15:13:49.771367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:21:48.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"53'1","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153287+0000","last_change":"2024-09-06T15:12:55.091165+0000","last_active":"2024-09-06T15:13:50.153287+0000","last_peered":"2024-09-06T15:13:50.153287+0000","last_clean":"2024-09-06T15:13:50.153287+0000","last_became_active":"2024-09-06T15:12:55.090795+0000","last_became_peered":"2024-09-06T15:12:55.090795+0000","last_unstale":"2024-09-06T15:13:50.153287+0000","last_undegraded":"2024-09-06T15:13:50.153287+0000","last_fullsized":"2024-09-06T15:13:50.153287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:33:27.042420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"60'11","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228908+0000","last_change":"2024-09-06T15:12:57.351942+0000","last_active":"2024-09-06T15:13:50.228908+0000","last_peered":"2024-09-06T15:13:50.228908+0000","last_clean":"2024-09-06T15:13:50.228908+0000","last_became_active":"2024-09-06T15:12:57.351660+0000","last_became_peered":"2024-09-06T15:12:57.351660+0000","last_unstale":"2024-09-06T15:13:50.228908+0000","last_undegraded":"2024-09-06T15:13:50.228908+0000","last_fullsized":"2024-09-06T15:13:50.228908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:08:20.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775764+0000","last_change":"2024-09-06T15:12:59.116167+0000","last_active":"2024-09-06T15:13:49.775764+0000","last_peered":"2024-09-06T15:13:49.775764+0000","last_clean":"2024-09-06T15:13:49.775764+0000","last_became_active":"2024-09-06T15:12:59.115609+0000","last_became_peered":"2024-09-06T15:12:59.115609+0000","last_unstale":"2024-09-06T15:13:49.775764+0000","last_undegraded":"2024-09-06T15:13:49.775764+0000","last_fullsized":"2024-09-06T15:13:49.775764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:53:57.082267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772296+0000","last_change":"2024-09-06T15:13:01.123916+0000","last_active":"2024-09-06T15:13:49.772296+0000","last_peered":"2024-09-06T15:13:49.772296+0000","last_clean":"2024-09-06T15:13:49.772296+0000","last_became_active":"2024-09-06T15:13:01.120929+0000","last_became_peered":"2024-09-06T15:13:01.120929+0000","last_unstale":"2024-09-06T15:13:49.772296+0000","last_undegraded":"2024-09-06T15:13:49.772296+0000","last_fullsized":"2024-09-06T15:13:49.772296+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:50:16.306941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231457+0000","last_change":"2024-09-06T15:12:55.109408+0000","last_active":"2024-09-06T15:13:50.231457+0000","last_peered":"2024-09-06T15:13:50.231457+0000","last_clean":"2024-09-06T15:13:50.231457+0000","last_became_active":"2024-09-06T15:12:55.108529+0000","last_became_peered":"2024-09-06T15:12:55.108529+0000","last_unstale":"2024-09-06T15:13:50.231457+0000","last_undegraded":"2024-09-06T15:13:50.231457+0000","last_fullsized":"2024-09-06T15:13:50.231457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:53:18.654600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230391+0000","last_change":"2024-09-06T15:12:57.100187+0000","last_active":"2024-09-06T15:13:50.230391+0000","last_peered":"2024-09-06T15:13:50.230391+0000","last_clean":"2024-09-06T15:13:50.230391+0000","last_became_active":"2024-09-06T15:12:57.099292+0000","last_became_peered":"2024-09-06T15:12:57.099292+0000","last_unstale":"2024-09-06T15:13:50.230391+0000","last_undegraded":"2024-09-06T15:13:50.230391+0000","last_fullsized":"2024-09-06T15:13:50.230391+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:38:33.847429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229065+0000","last_change":"2024-09-06T15:12:59.106266+0000","last_active":"2024-09-06T15:13:50.229065+0000","last_peered":"2024-09-06T15:13:50.229065+0000","last_clean":"2024-09-06T15:13:50.229065+0000","last_became_active":"2024-09-06T15:12:59.105374+0000","last_became_peered":"2024-09-06T15:12:59.105374+0000","last_unstale":"2024-09-06T15:13:50.229065+0000","last_undegraded":"2024-09-06T15:13:50.229065+0000","last_fullsized":"2024-09-06T15:13:50.229065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:18:45.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229048+0000","last_change":"2024-09-06T15:13:01.124998+0000","last_active":"2024-09-06T15:13:50.229048+0000","last_peered":"2024-09-06T15:13:50.229048+0000","last_clean":"2024-09-06T15:13:50.229048+0000","last_became_active":"2024-09-06T15:13:01.124250+0000","last_became_peered":"2024-09-06T15:13:01.124250+0000","last_unstale":"2024-09-06T15:13:50.229048+0000","last_undegraded":"2024-09-06T15:13:50.229048+0000","last_fullsized":"2024-09-06T15:13:50.229048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:50:53.431785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231474+0000","last_change":"2024-09-06T15:12:55.118326+0000","last_active":"2024-09-06T15:13:50.231474+0000","last_peered":"2024-09-06T15:13:50.231474+0000","last_clean":"2024-09-06T15:13:50.231474+0000","last_became_active":"2024-09-06T15:12:55.117499+0000","last_became_peered":"2024-09-06T15:12:55.117499+0000","last_unstale":"2024-09-06T15:13:50.231474+0000","last_undegraded":"2024-09-06T15:13:50.231474+0000","last_fullsized":"2024-09-06T15:13:50.231474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:07:45.699349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"60'12","reported_seq":59,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233157+0000","last_change":"2024-09-06T15:12:57.096146+0000","last_active":"2024-09-06T15:13:50.233157+0000","last_peered":"2024-09-06T15:13:50.233157+0000","last_clean":"2024-09-06T15:13:50.233157+0000","last_became_active":"2024-09-06T15:12:57.095347+0000","last_became_peered":"2024-09-06T15:12:57.095347+0000","last_unstale":"2024-09-06T15:13:50.233157+0000","last_undegraded":"2024-09-06T15:13:50.233157+0000","last_fullsized":"2024-09-06T15:13:50.233157+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:23:26.562774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229562+0000","last_change":"2024-09-06T15:12:59.129850+0000","last_active":"2024-09-06T15:13:50.229562+0000","last_peered":"2024-09-06T15:13:50.229562+0000","last_clean":"2024-09-06T15:13:50.229562+0000","last_became_active":"2024-09-06T15:12:59.128959+0000","last_became_peered":"2024-09-06T15:12:59.128959+0000","last_unstale":"2024-09-06T15:13:50.229562+0000","last_undegraded":"2024-09-06T15:13:50.229562+0000","last_fullsized":"2024-09-06T15:13:50.229562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:31.000370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225327+0000","last_change":"2024-09-06T15:13:01.134475+0000","last_active":"2024-09-06T15:13:50.225327+0000","last_peered":"2024-09-06T15:13:50.225327+0000","last_clean":"2024-09-06T15:13:50.225327+0000","last_became_active":"2024-09-06T15:13:01.133803+0000","last_became_peered":"2024-09-06T15:13:01.133803+0000","last_unstale":"2024-09-06T15:13:50.225327+0000","last_undegraded":"2024-09-06T15:13:50.225327+0000","last_fullsized":"2024-09-06T15:13:50.225327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:55:00.074355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"60'19","reported_seq":67,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232462+0000","last_change":"2024-09-06T15:12:57.103675+0000","last_active":"2024-09-06T15:13:50.232462+0000","last_peered":"2024-09-06T15:13:50.232462+0000","last_clean":"2024-09-06T15:13:50.232462+0000","last_became_active":"2024-09-06T15:12:57.103363+0000","last_became_peered":"2024-09-06T15:12:57.103363+0000","last_unstale":"2024-09-06T15:13:50.232462+0000","last_undegraded":"2024-09-06T15:13:50.232462+0000","last_fullsized":"2024-09-06T15:13:50.232462+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:42:11.938934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227410+0000","last_change":"2024-09-06T15:13:39.349491+0000","last_active":"2024-09-06T15:13:50.227410+0000","last_peered":"2024-09-06T15:13:50.227410+0000","last_clean":"2024-09-06T15:13:50.227410+0000","last_became_active":"2024-09-06T15:13:39.348882+0000","last_became_peered":"2024-09-06T15:13:39.348882+0000","last_unstale":"2024-09-06T15:13:50.227410+0000","last_undegraded":"2024-09-06T15:13:50.227410+0000","last_fullsized":"2024-09-06T15:13:50.227410+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:42:45.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774404+0000","last_change":"2024-09-06T15:12:59.107571+0000","last_active":"2024-09-06T15:13:49.774404+0000","last_peered":"2024-09-06T15:13:49.774404+0000","last_clean":"2024-09-06T15:13:49.774404+0000","last_became_active":"2024-09-06T15:12:59.105677+0000","last_became_peered":"2024-09-06T15:12:59.105677+0000","last_unstale":"2024-09-06T15:13:49.774404+0000","last_undegraded":"2024-09-06T15:13:49.774404+0000","last_fullsized":"2024-09-06T15:13:49.774404+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:30:58.244201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227368+0000","last_change":"2024-09-06T15:13:01.142271+0000","last_active":"2024-09-06T15:13:50.227368+0000","last_peered":"2024-09-06T15:13:50.227368+0000","last_clean":"2024-09-06T15:13:50.227368+0000","last_became_active":"2024-09-06T15:13:01.141670+0000","last_became_peered":"2024-09-06T15:13:01.141670+0000","last_unstale":"2024-09-06T15:13:50.227368+0000","last_undegraded":"2024-09-06T15:13:50.227368+0000","last_fullsized":"2024-09-06T15:13:50.227368+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:16:05.170823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151783+0000","last_change":"2024-09-06T15:12:57.096440+0000","last_active":"2024-09-06T15:13:50.151783+0000","last_peered":"2024-09-06T15:13:50.151783+0000","last_clean":"2024-09-06T15:13:50.151783+0000","last_became_active":"2024-09-06T15:12:57.095615+0000","last_became_peered":"2024-09-06T15:12:57.095615+0000","last_unstale":"2024-09-06T15:13:50.151783+0000","last_undegraded":"2024-09-06T15:13:50.151783+0000","last_fullsized":"2024-09-06T15:13:50.151783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:26:02.366170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774755+0000","last_change":"2024-09-06T15:12:55.097329+0000","last_active":"2024-09-06T15:13:49.774755+0000","last_peered":"2024-09-06T15:13:49.774755+0000","last_clean":"2024-09-06T15:13:49.774755+0000","last_became_active":"2024-09-06T15:12:55.096925+0000","last_became_peered":"2024-09-06T15:12:55.096925+0000","last_unstale":"2024-09-06T15:13:49.774755+0000","last_undegraded":"2024-09-06T15:13:49.774755+0000","last_fullsized":"2024-09-06T15:13:49.774755+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:43:43.362858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"60'11","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.275191+0000","last_change":"2024-09-06T15:12:59.112801+0000","last_active":"2024-09-06T15:15:00.275191+0000","last_peered":"2024-09-06T15:15:00.275191+0000","last_clean":"2024-09-06T15:15:00.275191+0000","last_became_active":"2024-09-06T15:12:59.111964+0000","last_became_peered":"2024-09-06T15:12:59.111964+0000","last_unstale":"2024-09-06T15:15:00.275191+0000","last_undegraded":"2024-09-06T15:15:00.275191+0000","last_fullsized":"2024-09-06T15:15:00.275191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:17:46.951059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772032+0000","last_change":"2024-09-06T15:13:01.115586+0000","last_active":"2024-09-06T15:13:49.772032+0000","last_peered":"2024-09-06T15:13:49.772032+0000","last_clean":"2024-09-06T15:13:49.772032+0000","last_became_active":"2024-09-06T15:13:01.114440+0000","last_became_peered":"2024-09-06T15:13:01.114440+0000","last_unstale":"2024-09-06T15:13:49.772032+0000","last_undegraded":"2024-09-06T15:13:49.772032+0000","last_fullsized":"2024-09-06T15:13:49.772032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:37:52.557829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150419+0000","last_change":"2024-09-06T15:12:57.102328+0000","last_active":"2024-09-06T15:13:50.150419+0000","last_peered":"2024-09-06T15:13:50.150419+0000","last_clean":"2024-09-06T15:13:50.150419+0000","last_became_active":"2024-09-06T15:12:57.100994+0000","last_became_peered":"2024-09-06T15:12:57.100994+0000","last_unstale":"2024-09-06T15:13:50.150419+0000","last_undegraded":"2024-09-06T15:13:50.150419+0000","last_fullsized":"2024-09-06T15:13:50.150419+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:33:30.988739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.776223+0000","last_change":"2024-09-06T15:12:55.095595+0000","last_active":"2024-09-06T15:13:49.776223+0000","last_peered":"2024-09-06T15:13:49.776223+0000","last_clean":"2024-09-06T15:13:49.776223+0000","last_became_active":"2024-09-06T15:12:55.095247+0000","last_became_peered":"2024-09-06T15:12:55.095247+0000","last_unstale":"2024-09-06T15:13:49.776223+0000","last_undegraded":"2024-09-06T15:13:49.776223+0000","last_fullsized":"2024-09-06T15:13:49.776223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:16:41.884452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'11","reported_seq":72,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.278540+0000","last_change":"2024-09-06T15:12:59.110250+0000","last_active":"2024-09-06T15:15:00.278540+0000","last_peered":"2024-09-06T15:15:00.278540+0000","last_clean":"2024-09-06T15:15:00.278540+0000","last_became_active":"2024-09-06T15:12:59.109147+0000","last_became_peered":"2024-09-06T15:12:59.109147+0000","last_unstale":"2024-09-06T15:15:00.278540+0000","last_undegraded":"2024-09-06T15:15:00.278540+0000","last_fullsized":"2024-09-06T15:15:00.278540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:38:06.742551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228703+0000","last_change":"2024-09-06T15:13:01.135779+0000","last_active":"2024-09-06T15:13:50.228703+0000","last_peered":"2024-09-06T15:13:50.228703+0000","last_clean":"2024-09-06T15:13:50.228703+0000","last_became_active":"2024-09-06T15:13:01.135022+0000","last_became_peered":"2024-09-06T15:13:01.135022+0000","last_unstale":"2024-09-06T15:13:50.228703+0000","last_undegraded":"2024-09-06T15:13:50.228703+0000","last_fullsized":"2024-09-06T15:13:50.228703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:05:45.214445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"60'12","reported_seq":59,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772053+0000","last_change":"2024-09-06T15:12:57.356101+0000","last_active":"2024-09-06T15:13:49.772053+0000","last_peered":"2024-09-06T15:13:49.772053+0000","last_clean":"2024-09-06T15:13:49.772053+0000","last_became_active":"2024-09-06T15:12:57.355106+0000","last_became_peered":"2024-09-06T15:12:57.355106+0000","last_unstale":"2024-09-06T15:13:49.772053+0000","last_undegraded":"2024-09-06T15:13:49.772053+0000","last_fullsized":"2024-09-06T15:13:49.772053+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:48:11.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232057+0000","last_change":"2024-09-06T15:12:55.104906+0000","last_active":"2024-09-06T15:13:50.232057+0000","last_peered":"2024-09-06T15:13:50.232057+0000","last_clean":"2024-09-06T15:13:50.232057+0000","last_became_active":"2024-09-06T15:12:55.104118+0000","last_became_peered":"2024-09-06T15:12:55.104118+0000","last_unstale":"2024-09-06T15:13:50.232057+0000","last_undegraded":"2024-09-06T15:13:50.232057+0000","last_fullsized":"2024-09-06T15:13:50.232057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:58:55.713885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233525+0000","last_change":"2024-09-06T15:12:59.126725+0000","last_active":"2024-09-06T15:13:50.233525+0000","last_peered":"2024-09-06T15:13:50.233525+0000","last_clean":"2024-09-06T15:13:50.233525+0000","last_became_active":"2024-09-06T15:12:59.124707+0000","last_became_peered":"2024-09-06T15:12:59.124707+0000","last_unstale":"2024-09-06T15:13:50.233525+0000","last_undegraded":"2024-09-06T15:13:50.233525+0000","last_fullsized":"2024-09-06T15:13:50.233525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:32:38.998719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151887+0000","last_change":"2024-09-06T15:13:01.196591+0000","last_active":"2024-09-06T15:13:50.151887+0000","last_peered":"2024-09-06T15:13:50.151887+0000","last_clean":"2024-09-06T15:13:50.151887+0000","last_became_active":"2024-09-06T15:13:01.195670+0000","last_became_peered":"2024-09-06T15:13:01.195670+0000","last_unstale":"2024-09-06T15:13:50.151887+0000","last_undegraded":"2024-09-06T15:13:50.151887+0000","last_fullsized":"2024-09-06T15:13:50.151887+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:49:48.311248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"60'12","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228541+0000","last_change":"2024-09-06T15:12:57.118391+0000","last_active":"2024-09-06T15:13:50.228541+0000","last_peered":"2024-09-06T15:13:50.228541+0000","last_clean":"2024-09-06T15:13:50.228541+0000","last_became_active":"2024-09-06T15:12:57.117639+0000","last_became_peered":"2024-09-06T15:12:57.117639+0000","last_unstale":"2024-09-06T15:13:50.228541+0000","last_undegraded":"2024-09-06T15:13:50.228541+0000","last_fullsized":"2024-09-06T15:13:50.228541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:32:30.210338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233588+0000","last_change":"2024-09-06T15:12:55.101415+0000","last_active":"2024-09-06T15:13:50.233588+0000","last_peered":"2024-09-06T15:13:50.233588+0000","last_clean":"2024-09-06T15:13:50.233588+0000","last_became_active":"2024-09-06T15:12:55.100471+0000","last_became_peered":"2024-09-06T15:12:55.100471+0000","last_unstale":"2024-09-06T15:13:50.233588+0000","last_undegraded":"2024-09-06T15:13:50.233588+0000","last_fullsized":"2024-09-06T15:13:50.233588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:43:55.396985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"61'1","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772338+0000","last_change":"2024-09-06T15:13:07.173640+0000","last_active":"2024-09-06T15:13:49.772338+0000","last_peered":"2024-09-06T15:13:49.772338+0000","last_clean":"2024-09-06T15:13:49.772338+0000","last_became_active":"2024-09-06T15:12:58.086331+0000","last_became_peered":"2024-09-06T15:12:58.086331+0000","last_unstale":"2024-09-06T15:13:49.772338+0000","last_undegraded":"2024-09-06T15:13:49.772338+0000","last_fullsized":"2024-09-06T15:13:49.772338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:12:46.881435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042015230000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"60'11","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.791912+0000","last_change":"2024-09-06T15:12:59.130405+0000","last_active":"2024-09-06T15:15:00.791912+0000","last_peered":"2024-09-06T15:15:00.791912+0000","last_clean":"2024-09-06T15:15:00.791912+0000","last_became_active":"2024-09-06T15:12:59.128274+0000","last_became_peered":"2024-09-06T15:12:59.128274+0000","last_unstale":"2024-09-06T15:15:00.791912+0000","last_undegraded":"2024-09-06T15:15:00.791912+0000","last_fullsized":"2024-09-06T15:15:00.791912+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:39:47.880992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229648+0000","last_change":"2024-09-06T15:13:01.198352+0000","last_active":"2024-09-06T15:13:50.229648+0000","last_peered":"2024-09-06T15:13:50.229648+0000","last_clean":"2024-09-06T15:13:50.229648+0000","last_became_active":"2024-09-06T15:13:01.197458+0000","last_became_peered":"2024-09-06T15:13:01.197458+0000","last_unstale":"2024-09-06T15:13:50.229648+0000","last_undegraded":"2024-09-06T15:13:50.229648+0000","last_fullsized":"2024-09-06T15:13:50.229648+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:41:36.803582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"60'13","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153226+0000","last_change":"2024-09-06T15:12:57.099261+0000","last_active":"2024-09-06T15:13:50.153226+0000","last_peered":"2024-09-06T15:13:50.153226+0000","last_clean":"2024-09-06T15:13:50.153226+0000","last_became_active":"2024-09-06T15:12:57.098052+0000","last_became_peered":"2024-09-06T15:12:57.098052+0000","last_unstale":"2024-09-06T15:13:50.153226+0000","last_undegraded":"2024-09-06T15:13:50.153226+0000","last_fullsized":"2024-09-06T15:13:50.153226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:31:46.440736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"53'1","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775742+0000","last_change":"2024-09-06T15:12:55.092136+0000","last_active":"2024-09-06T15:13:49.775742+0000","last_peered":"2024-09-06T15:13:49.775742+0000","last_clean":"2024-09-06T15:13:49.775742+0000","last_became_active":"2024-09-06T15:12:55.091652+0000","last_became_peered":"2024-09-06T15:12:55.091652+0000","last_unstale":"2024-09-06T15:13:49.775742+0000","last_undegraded":"2024-09-06T15:13:49.775742+0000","last_fullsized":"2024-09-06T15:13:49.775742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:34:31.853590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"64'5","reported_seq":156,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:04.399293+0000","last_change":"2024-09-06T15:13:07.607659+0000","last_active":"2024-09-06T15:15:04.399293+0000","last_peered":"2024-09-06T15:15:04.399293+0000","last_clean":"2024-09-06T15:15:04.399293+0000","last_became_active":"2024-09-06T15:12:58.094980+0000","last_became_peered":"2024-09-06T15:12:58.094980+0000","last_unstale":"2024-09-06T15:15:04.399293+0000","last_undegraded":"2024-09-06T15:15:04.399293+0000","last_fullsized":"2024-09-06T15:15:04.399293+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:33:10.005559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006319842,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771725+0000","last_change":"2024-09-06T15:12:59.125226+0000","last_active":"2024-09-06T15:13:49.771725+0000","last_peered":"2024-09-06T15:13:49.771725+0000","last_clean":"2024-09-06T15:13:49.771725+0000","last_became_active":"2024-09-06T15:12:59.124354+0000","last_became_peered":"2024-09-06T15:12:59.124354+0000","last_unstale":"2024-09-06T15:13:49.771725+0000","last_undegraded":"2024-09-06T15:13:49.771725+0000","last_fullsized":"2024-09-06T15:13:49.771725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:03:27.676005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772403+0000","last_change":"2024-09-06T15:13:01.143786+0000","last_active":"2024-09-06T15:13:49.772403+0000","last_peered":"2024-09-06T15:13:49.772403+0000","last_clean":"2024-09-06T15:13:49.772403+0000","last_became_active":"2024-09-06T15:13:01.142908+0000","last_became_peered":"2024-09-06T15:13:01.142908+0000","last_unstale":"2024-09-06T15:13:49.772403+0000","last_undegraded":"2024-09-06T15:13:49.772403+0000","last_fullsized":"2024-09-06T15:13:49.772403+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:54:49.552486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"60'30","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.790356+0000","last_change":"2024-09-06T15:12:57.351412+0000","last_active":"2024-09-06T15:15:00.790356+0000","last_peered":"2024-09-06T15:15:00.790356+0000","last_clean":"2024-09-06T15:15:00.790356+0000","last_became_active":"2024-09-06T15:12:57.351080+0000","last_became_peered":"2024-09-06T15:12:57.351080+0000","last_unstale":"2024-09-06T15:15:00.790356+0000","last_undegraded":"2024-09-06T15:15:00.790356+0000","last_fullsized":"2024-09-06T15:15:00.790356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:24.303744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231808+0000","last_change":"2024-09-06T15:12:55.112289+0000","last_active":"2024-09-06T15:13:50.231808+0000","last_peered":"2024-09-06T15:13:50.231808+0000","last_clean":"2024-09-06T15:13:50.231808+0000","last_became_active":"2024-09-06T15:12:55.111439+0000","last_became_peered":"2024-09-06T15:12:55.111439+0000","last_unstale":"2024-09-06T15:13:50.231808+0000","last_undegraded":"2024-09-06T15:13:50.231808+0000","last_fullsized":"2024-09-06T15:13:50.231808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:04:05.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232117+0000","last_change":"2024-09-06T15:12:59.137041+0000","last_active":"2024-09-06T15:13:50.232117+0000","last_peered":"2024-09-06T15:13:50.232117+0000","last_clean":"2024-09-06T15:13:50.232117+0000","last_became_active":"2024-09-06T15:12:59.136465+0000","last_became_peered":"2024-09-06T15:12:59.136465+0000","last_unstale":"2024-09-06T15:13:50.232117+0000","last_undegraded":"2024-09-06T15:13:50.232117+0000","last_fullsized":"2024-09-06T15:13:50.232117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:22:50.495480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775624+0000","last_change":"2024-09-06T15:13:01.193132+0000","last_active":"2024-09-06T15:13:49.775624+0000","last_peered":"2024-09-06T15:13:49.775624+0000","last_clean":"2024-09-06T15:13:49.775624+0000","last_became_active":"2024-09-06T15:13:01.192052+0000","last_became_peered":"2024-09-06T15:13:01.192052+0000","last_unstale":"2024-09-06T15:13:49.775624+0000","last_undegraded":"2024-09-06T15:13:49.775624+0000","last_fullsized":"2024-09-06T15:13:49.775624+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:55:16.512402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'16","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.283501+0000","last_change":"2024-09-06T15:12:57.354749+0000","last_active":"2024-09-06T15:15:05.283501+0000","last_peered":"2024-09-06T15:15:05.283501+0000","last_clean":"2024-09-06T15:15:05.283501+0000","last_became_active":"2024-09-06T15:12:57.353904+0000","last_became_peered":"2024-09-06T15:12:57.353904+0000","last_unstale":"2024-09-06T15:15:05.283501+0000","last_undegraded":"2024-09-06T15:15:05.283501+0000","last_fullsized":"2024-09-06T15:15:05.283501+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:32:46.266782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774681+0000","last_change":"2024-09-06T15:12:55.088071+0000","last_active":"2024-09-06T15:13:49.774681+0000","last_peered":"2024-09-06T15:13:49.774681+0000","last_clean":"2024-09-06T15:13:49.774681+0000","last_became_active":"2024-09-06T15:12:55.087713+0000","last_became_peered":"2024-09-06T15:12:55.087713+0000","last_unstale":"2024-09-06T15:13:49.774681+0000","last_undegraded":"2024-09-06T15:13:49.774681+0000","last_fullsized":"2024-09-06T15:13:49.774681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:16:04.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"63'2","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774411+0000","last_change":"2024-09-06T15:13:07.160379+0000","last_active":"2024-09-06T15:13:49.774411+0000","last_peered":"2024-09-06T15:13:49.774411+0000","last_clean":"2024-09-06T15:13:49.774411+0000","last_became_active":"2024-09-06T15:12:58.096521+0000","last_became_peered":"2024-09-06T15:12:58.096521+0000","last_unstale":"2024-09-06T15:13:49.774411+0000","last_undegraded":"2024-09-06T15:13:49.774411+0000","last_fullsized":"2024-09-06T15:13:49.774411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:31:44.378001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001223165,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'11","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.275583+0000","last_change":"2024-09-06T15:12:59.119701+0000","last_active":"2024-09-06T15:15:00.275583+0000","last_peered":"2024-09-06T15:15:00.275583+0000","last_clean":"2024-09-06T15:15:00.275583+0000","last_became_active":"2024-09-06T15:12:59.118912+0000","last_became_peered":"2024-09-06T15:12:59.118912+0000","last_unstale":"2024-09-06T15:15:00.275583+0000","last_undegraded":"2024-09-06T15:15:00.275583+0000","last_fullsized":"2024-09-06T15:15:00.275583+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:11:40.386238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225497+0000","last_change":"2024-09-06T15:13:01.131691+0000","last_active":"2024-09-06T15:13:50.225497+0000","last_peered":"2024-09-06T15:13:50.225497+0000","last_clean":"2024-09-06T15:13:50.225497+0000","last_became_active":"2024-09-06T15:13:01.130754+0000","last_became_peered":"2024-09-06T15:13:01.130754+0000","last_unstale":"2024-09-06T15:13:50.225497+0000","last_undegraded":"2024-09-06T15:13:50.225497+0000","last_fullsized":"2024-09-06T15:13:50.225497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:34:45.535565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"60'19","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771744+0000","last_change":"2024-09-06T15:12:57.096006+0000","last_active":"2024-09-06T15:13:49.771744+0000","last_peered":"2024-09-06T15:13:49.771744+0000","last_clean":"2024-09-06T15:13:49.771744+0000","last_became_active":"2024-09-06T15:12:57.095680+0000","last_became_peered":"2024-09-06T15:12:57.095680+0000","last_unstale":"2024-09-06T15:13:49.771744+0000","last_undegraded":"2024-09-06T15:13:49.771744+0000","last_fullsized":"2024-09-06T15:13:49.771744+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:41:48.387977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230238+0000","last_change":"2024-09-06T15:12:55.111796+0000","last_active":"2024-09-06T15:13:50.230238+0000","last_peered":"2024-09-06T15:13:50.230238+0000","last_clean":"2024-09-06T15:13:50.230238+0000","last_became_active":"2024-09-06T15:12:55.110987+0000","last_became_peered":"2024-09-06T15:12:55.110987+0000","last_unstale":"2024-09-06T15:13:50.230238+0000","last_undegraded":"2024-09-06T15:13:50.230238+0000","last_fullsized":"2024-09-06T15:13:50.230238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:31:09.647656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227436+0000","last_change":"2024-09-06T15:12:59.112223+0000","last_active":"2024-09-06T15:13:50.227436+0000","last_peered":"2024-09-06T15:13:50.227436+0000","last_clean":"2024-09-06T15:13:50.227436+0000","last_became_active":"2024-09-06T15:12:59.111351+0000","last_became_peered":"2024-09-06T15:12:59.111351+0000","last_unstale":"2024-09-06T15:13:50.227436+0000","last_undegraded":"2024-09-06T15:13:50.227436+0000","last_fullsized":"2024-09-06T15:13:50.227436+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:12:35.386546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.152675+0000","last_change":"2024-09-06T15:13:01.145345+0000","last_active":"2024-09-06T15:13:50.152675+0000","last_peered":"2024-09-06T15:13:50.152675+0000","last_clean":"2024-09-06T15:13:50.152675+0000","last_became_active":"2024-09-06T15:13:01.144615+0000","last_became_peered":"2024-09-06T15:13:01.144615+0000","last_unstale":"2024-09-06T15:13:50.152675+0000","last_undegraded":"2024-09-06T15:13:50.152675+0000","last_fullsized":"2024-09-06T15:13:50.152675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:00:11.800063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"60'18","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775431+0000","last_change":"2024-09-06T15:12:57.351422+0000","last_active":"2024-09-06T15:13:49.775431+0000","last_peered":"2024-09-06T15:13:49.775431+0000","last_clean":"2024-09-06T15:13:49.775431+0000","last_became_active":"2024-09-06T15:12:57.351166+0000","last_became_peered":"2024-09-06T15:12:57.351166+0000","last_unstale":"2024-09-06T15:13:49.775431+0000","last_undegraded":"2024-09-06T15:13:49.775431+0000","last_fullsized":"2024-09-06T15:13:49.775431+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:18:59.755641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227421+0000","last_change":"2024-09-06T15:12:55.089677+0000","last_active":"2024-09-06T15:13:50.227421+0000","last_peered":"2024-09-06T15:13:50.227421+0000","last_clean":"2024-09-06T15:13:50.227421+0000","last_became_active":"2024-09-06T15:12:55.089262+0000","last_became_peered":"2024-09-06T15:12:55.089262+0000","last_unstale":"2024-09-06T15:13:50.227421+0000","last_undegraded":"2024-09-06T15:13:50.227421+0000","last_fullsized":"2024-09-06T15:13:50.227421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:24:00.795821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227344+0000","last_change":"2024-09-06T15:12:59.112550+0000","last_active":"2024-09-06T15:13:50.227344+0000","last_peered":"2024-09-06T15:13:50.227344+0000","last_clean":"2024-09-06T15:13:50.227344+0000","last_became_active":"2024-09-06T15:12:59.111748+0000","last_became_peered":"2024-09-06T15:12:59.111748+0000","last_unstale":"2024-09-06T15:13:50.227344+0000","last_undegraded":"2024-09-06T15:13:50.227344+0000","last_fullsized":"2024-09-06T15:13:50.227344+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:50:52.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230515+0000","last_change":"2024-09-06T15:13:01.200713+0000","last_active":"2024-09-06T15:13:50.230515+0000","last_peered":"2024-09-06T15:13:50.230515+0000","last_clean":"2024-09-06T15:13:50.230515+0000","last_became_active":"2024-09-06T15:13:01.199889+0000","last_became_peered":"2024-09-06T15:13:01.199889+0000","last_unstale":"2024-09-06T15:13:50.230515+0000","last_undegraded":"2024-09-06T15:13:50.230515+0000","last_fullsized":"2024-09-06T15:13:50.230515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:21:48.608030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"60'14","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227960+0000","last_change":"2024-09-06T15:12:57.105810+0000","last_active":"2024-09-06T15:13:50.227960+0000","last_peered":"2024-09-06T15:13:50.227960+0000","last_clean":"2024-09-06T15:13:50.227960+0000","last_became_active":"2024-09-06T15:12:57.104958+0000","last_became_peered":"2024-09-06T15:12:57.104958+0000","last_unstale":"2024-09-06T15:13:50.227960+0000","last_undegraded":"2024-09-06T15:13:50.227960+0000","last_fullsized":"2024-09-06T15:13:50.227960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:55:28.379123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232293+0000","last_change":"2024-09-06T15:12:55.096936+0000","last_active":"2024-09-06T15:13:50.232293+0000","last_peered":"2024-09-06T15:13:50.232293+0000","last_clean":"2024-09-06T15:13:50.232293+0000","last_became_active":"2024-09-06T15:12:55.095612+0000","last_became_peered":"2024-09-06T15:12:55.095612+0000","last_unstale":"2024-09-06T15:13:50.232293+0000","last_undegraded":"2024-09-06T15:13:50.232293+0000","last_fullsized":"2024-09-06T15:13:50.232293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:15:53.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233602+0000","last_change":"2024-09-06T15:12:59.134094+0000","last_active":"2024-09-06T15:13:50.233602+0000","last_peered":"2024-09-06T15:13:50.233602+0000","last_clean":"2024-09-06T15:13:50.233602+0000","last_became_active":"2024-09-06T15:12:59.133552+0000","last_became_peered":"2024-09-06T15:12:59.133552+0000","last_unstale":"2024-09-06T15:13:50.233602+0000","last_undegraded":"2024-09-06T15:13:50.233602+0000","last_fullsized":"2024-09-06T15:13:50.233602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:57:30.973206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774347+0000","last_change":"2024-09-06T15:13:01.139393+0000","last_active":"2024-09-06T15:13:49.774347+0000","last_peered":"2024-09-06T15:13:49.774347+0000","last_clean":"2024-09-06T15:13:49.774347+0000","last_became_active":"2024-09-06T15:13:01.138509+0000","last_became_peered":"2024-09-06T15:13:01.138509+0000","last_unstale":"2024-09-06T15:13:49.774347+0000","last_undegraded":"2024-09-06T15:13:49.774347+0000","last_fullsized":"2024-09-06T15:13:49.774347+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:50:37.575978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"60'10","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150810+0000","last_change":"2024-09-06T15:12:57.099104+0000","last_active":"2024-09-06T15:13:50.150810+0000","last_peered":"2024-09-06T15:13:50.150810+0000","last_clean":"2024-09-06T15:13:50.150810+0000","last_became_active":"2024-09-06T15:12:57.097862+0000","last_became_peered":"2024-09-06T15:12:57.097862+0000","last_unstale":"2024-09-06T15:13:50.150810+0000","last_undegraded":"2024-09-06T15:13:50.150810+0000","last_fullsized":"2024-09-06T15:13:50.150810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:06:26.498012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231008+0000","last_change":"2024-09-06T15:12:55.122753+0000","last_active":"2024-09-06T15:13:50.231008+0000","last_peered":"2024-09-06T15:13:50.231008+0000","last_clean":"2024-09-06T15:13:50.231008+0000","last_became_active":"2024-09-06T15:12:55.121954+0000","last_became_peered":"2024-09-06T15:12:55.121954+0000","last_unstale":"2024-09-06T15:13:50.231008+0000","last_undegraded":"2024-09-06T15:13:50.231008+0000","last_fullsized":"2024-09-06T15:13:50.231008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:22:08.508140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"67'79","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:52.156256+0000","last_change":"2024-09-06T15:12:24.320138+0000","last_active":"2024-09-06T15:13:52.156256+0000","last_peered":"2024-09-06T15:13:52.156256+0000","last_clean":"2024-09-06T15:13:52.156256+0000","last_became_active":"2024-09-06T15:12:24.304986+0000","last_became_peered":"2024-09-06T15:12:24.304986+0000","last_unstale":"2024-09-06T15:13:52.156256+0000","last_undegraded":"2024-09-06T15:13:52.156256+0000","last_fullsized":"2024-09-06T15:13:52.156256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:07:52.568740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:07:52.568740+0000","last_clean_scrub_stamp":"2024-09-06T15:07:52.568740+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:35:50.913133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230720+0000","last_change":"2024-09-06T15:12:59.118099+0000","last_active":"2024-09-06T15:13:50.230720+0000","last_peered":"2024-09-06T15:13:50.230720+0000","last_clean":"2024-09-06T15:13:50.230720+0000","last_became_active":"2024-09-06T15:12:59.117143+0000","last_became_peered":"2024-09-06T15:12:59.117143+0000","last_unstale":"2024-09-06T15:13:50.230720+0000","last_undegraded":"2024-09-06T15:13:50.230720+0000","last_fullsized":"2024-09-06T15:13:50.230720+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:48:18.712688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233310+0000","last_change":"2024-09-06T15:13:01.139470+0000","last_active":"2024-09-06T15:13:50.233310+0000","last_peered":"2024-09-06T15:13:50.233310+0000","last_clean":"2024-09-06T15:13:50.233310+0000","last_became_active":"2024-09-06T15:13:01.138815+0000","last_became_peered":"2024-09-06T15:13:01.138815+0000","last_unstale":"2024-09-06T15:13:50.233310+0000","last_undegraded":"2024-09-06T15:13:50.233310+0000","last_fullsized":"2024-09-06T15:13:50.233310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:48:50.225517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"60'17","reported_seq":64,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231108+0000","last_change":"2024-09-06T15:12:57.105794+0000","last_active":"2024-09-06T15:13:50.231108+0000","last_peered":"2024-09-06T15:13:50.231108+0000","last_clean":"2024-09-06T15:13:50.231108+0000","last_became_active":"2024-09-06T15:12:57.105310+0000","last_became_peered":"2024-09-06T15:12:57.105310+0000","last_unstale":"2024-09-06T15:13:50.231108+0000","last_undegraded":"2024-09-06T15:13:50.231108+0000","last_fullsized":"2024-09-06T15:13:50.231108+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:29:38.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226360+0000","last_change":"2024-09-06T15:12:55.092923+0000","last_active":"2024-09-06T15:13:50.226360+0000","last_peered":"2024-09-06T15:13:50.226360+0000","last_clean":"2024-09-06T15:13:50.226360+0000","last_became_active":"2024-09-06T15:12:55.091127+0000","last_became_peered":"2024-09-06T15:12:55.091127+0000","last_unstale":"2024-09-06T15:13:50.226360+0000","last_undegraded":"2024-09-06T15:13:50.226360+0000","last_fullsized":"2024-09-06T15:13:50.226360+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:24:26.113261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227620+0000","last_change":"2024-09-06T15:12:59.102301+0000","last_active":"2024-09-06T15:13:50.227620+0000","last_peered":"2024-09-06T15:13:50.227620+0000","last_clean":"2024-09-06T15:13:50.227620+0000","last_became_active":"2024-09-06T15:12:59.101826+0000","last_became_peered":"2024-09-06T15:12:59.101826+0000","last_unstale":"2024-09-06T15:13:50.227620+0000","last_undegraded":"2024-09-06T15:13:50.227620+0000","last_fullsized":"2024-09-06T15:13:50.227620+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:51:59.015592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232434+0000","last_change":"2024-09-06T15:13:01.146410+0000","last_active":"2024-09-06T15:13:50.232434+0000","last_peered":"2024-09-06T15:13:50.232434+0000","last_clean":"2024-09-06T15:13:50.232434+0000","last_became_active":"2024-09-06T15:13:01.145631+0000","last_became_peered":"2024-09-06T15:13:01.145631+0000","last_unstale":"2024-09-06T15:13:50.232434+0000","last_undegraded":"2024-09-06T15:13:50.232434+0000","last_fullsized":"2024-09-06T15:13:50.232434+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:39:35.617066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"60'10","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230599+0000","last_change":"2024-09-06T15:12:57.098398+0000","last_active":"2024-09-06T15:13:50.230599+0000","last_peered":"2024-09-06T15:13:50.230599+0000","last_clean":"2024-09-06T15:13:50.230599+0000","last_became_active":"2024-09-06T15:12:57.098079+0000","last_became_peered":"2024-09-06T15:12:57.098079+0000","last_unstale":"2024-09-06T15:13:50.230599+0000","last_undegraded":"2024-09-06T15:13:50.230599+0000","last_fullsized":"2024-09-06T15:13:50.230599+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:14:40.693481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775153+0000","last_change":"2024-09-06T15:12:55.085708+0000","last_active":"2024-09-06T15:13:49.775153+0000","last_peered":"2024-09-06T15:13:49.775153+0000","last_clean":"2024-09-06T15:13:49.775153+0000","last_became_active":"2024-09-06T15:12:55.085406+0000","last_became_peered":"2024-09-06T15:12:55.085406+0000","last_unstale":"2024-09-06T15:13:49.775153+0000","last_undegraded":"2024-09-06T15:13:49.775153+0000","last_fullsized":"2024-09-06T15:13:49.775153+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:44:40.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225622+0000","last_change":"2024-09-06T15:12:59.120543+0000","last_active":"2024-09-06T15:13:50.225622+0000","last_peered":"2024-09-06T15:13:50.225622+0000","last_clean":"2024-09-06T15:13:50.225622+0000","last_became_active":"2024-09-06T15:12:59.120226+0000","last_became_peered":"2024-09-06T15:12:59.120226+0000","last_unstale":"2024-09-06T15:13:50.225622+0000","last_undegraded":"2024-09-06T15:13:50.225622+0000","last_fullsized":"2024-09-06T15:13:50.225622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:05:02.253548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227767+0000","last_change":"2024-09-06T15:13:01.128764+0000","last_active":"2024-09-06T15:13:50.227767+0000","last_peered":"2024-09-06T15:13:50.227767+0000","last_clean":"2024-09-06T15:13:50.227767+0000","last_became_active":"2024-09-06T15:13:01.127887+0000","last_became_peered":"2024-09-06T15:13:01.127887+0000","last_unstale":"2024-09-06T15:13:50.227767+0000","last_undegraded":"2024-09-06T15:13:50.227767+0000","last_fullsized":"2024-09-06T15:13:50.227767+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:26:54.636621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229090+0000","last_change":"2024-09-06T15:12:57.113708+0000","last_active":"2024-09-06T15:13:50.229090+0000","last_peered":"2024-09-06T15:13:50.229090+0000","last_clean":"2024-09-06T15:13:50.229090+0000","last_became_active":"2024-09-06T15:12:57.113436+0000","last_became_peered":"2024-09-06T15:12:57.113436+0000","last_unstale":"2024-09-06T15:13:50.229090+0000","last_undegraded":"2024-09-06T15:13:50.229090+0000","last_fullsized":"2024-09-06T15:13:50.229090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:51:23.773058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227876+0000","last_change":"2024-09-06T15:12:55.096250+0000","last_active":"2024-09-06T15:13:50.227876+0000","last_peered":"2024-09-06T15:13:50.227876+0000","last_clean":"2024-09-06T15:13:50.227876+0000","last_became_active":"2024-09-06T15:12:55.095951+0000","last_became_peered":"2024-09-06T15:12:55.095951+0000","last_unstale":"2024-09-06T15:13:50.227876+0000","last_undegraded":"2024-09-06T15:13:50.227876+0000","last_fullsized":"2024-09-06T15:13:50.227876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:12:21.620719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'11","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.278548+0000","last_change":"2024-09-06T15:12:59.110950+0000","last_active":"2024-09-06T15:15:00.278548+0000","last_peered":"2024-09-06T15:15:00.278548+0000","last_clean":"2024-09-06T15:15:00.278548+0000","last_became_active":"2024-09-06T15:12:59.109075+0000","last_became_peered":"2024-09-06T15:12:59.109075+0000","last_unstale":"2024-09-06T15:15:00.278548+0000","last_undegraded":"2024-09-06T15:15:00.278548+0000","last_fullsized":"2024-09-06T15:15:00.278548+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:08:46.878348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228868+0000","last_change":"2024-09-06T15:13:01.200431+0000","last_active":"2024-09-06T15:13:50.228868+0000","last_peered":"2024-09-06T15:13:50.228868+0000","last_clean":"2024-09-06T15:13:50.228868+0000","last_became_active":"2024-09-06T15:13:01.199431+0000","last_became_peered":"2024-09-06T15:13:01.199431+0000","last_unstale":"2024-09-06T15:13:50.228868+0000","last_undegraded":"2024-09-06T15:13:50.228868+0000","last_fullsized":"2024-09-06T15:13:50.228868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:26:36.957254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232975+0000","last_change":"2024-09-06T15:12:57.118928+0000","last_active":"2024-09-06T15:13:50.232975+0000","last_peered":"2024-09-06T15:13:50.232975+0000","last_clean":"2024-09-06T15:13:50.232975+0000","last_became_active":"2024-09-06T15:12:57.118496+0000","last_became_peered":"2024-09-06T15:12:57.118496+0000","last_unstale":"2024-09-06T15:13:50.232975+0000","last_undegraded":"2024-09-06T15:13:50.232975+0000","last_fullsized":"2024-09-06T15:13:50.232975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:25:26.970615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"53'3","reported_seq":64,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.773850+0000","last_change":"2024-09-06T15:12:55.095140+0000","last_active":"2024-09-06T15:13:49.773850+0000","last_peered":"2024-09-06T15:13:49.773850+0000","last_clean":"2024-09-06T15:13:49.773850+0000","last_became_active":"2024-09-06T15:12:55.094181+0000","last_became_peered":"2024-09-06T15:12:55.094181+0000","last_unstale":"2024-09-06T15:13:49.773850+0000","last_undegraded":"2024-09-06T15:13:49.773850+0000","last_fullsized":"2024-09-06T15:13:49.773850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:40:54.802365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.224796+0000","last_change":"2024-09-06T15:12:59.104127+0000","last_active":"2024-09-06T15:13:50.224796+0000","last_peered":"2024-09-06T15:13:50.224796+0000","last_clean":"2024-09-06T15:13:50.224796+0000","last_became_active":"2024-09-06T15:12:59.101623+0000","last_became_peered":"2024-09-06T15:12:59.101623+0000","last_unstale":"2024-09-06T15:13:50.224796+0000","last_undegraded":"2024-09-06T15:13:50.224796+0000","last_fullsized":"2024-09-06T15:13:50.224796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:14:02.253146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150550+0000","last_change":"2024-09-06T15:13:01.146792+0000","last_active":"2024-09-06T15:13:50.150550+0000","last_peered":"2024-09-06T15:13:50.150550+0000","last_clean":"2024-09-06T15:13:50.150550+0000","last_became_active":"2024-09-06T15:13:01.145857+0000","last_became_peered":"2024-09-06T15:13:01.145857+0000","last_unstale":"2024-09-06T15:13:50.150550+0000","last_undegraded":"2024-09-06T15:13:50.150550+0000","last_fullsized":"2024-09-06T15:13:50.150550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:58:51.407295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229755+0000","last_change":"2024-09-06T15:12:57.104501+0000","last_active":"2024-09-06T15:13:50.229755+0000","last_peered":"2024-09-06T15:13:50.229755+0000","last_clean":"2024-09-06T15:13:50.229755+0000","last_became_active":"2024-09-06T15:12:57.104095+0000","last_became_peered":"2024-09-06T15:12:57.104095+0000","last_unstale":"2024-09-06T15:13:50.229755+0000","last_undegraded":"2024-09-06T15:13:50.229755+0000","last_fullsized":"2024-09-06T15:13:50.229755+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:49:18.304775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225139+0000","last_change":"2024-09-06T15:12:55.091773+0000","last_active":"2024-09-06T15:13:50.225139+0000","last_peered":"2024-09-06T15:13:50.225139+0000","last_clean":"2024-09-06T15:13:50.225139+0000","last_became_active":"2024-09-06T15:12:55.090636+0000","last_became_peered":"2024-09-06T15:12:55.090636+0000","last_unstale":"2024-09-06T15:13:50.225139+0000","last_undegraded":"2024-09-06T15:13:50.225139+0000","last_fullsized":"2024-09-06T15:13:50.225139+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:59:52.887859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153128+0000","last_change":"2024-09-06T15:12:59.129100+0000","last_active":"2024-09-06T15:13:50.153128+0000","last_peered":"2024-09-06T15:13:50.153128+0000","last_clean":"2024-09-06T15:13:50.153128+0000","last_became_active":"2024-09-06T15:12:59.128537+0000","last_became_peered":"2024-09-06T15:12:59.128537+0000","last_unstale":"2024-09-06T15:13:50.153128+0000","last_undegraded":"2024-09-06T15:13:50.153128+0000","last_fullsized":"2024-09-06T15:13:50.153128+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:42:33.530016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225903+0000","last_change":"2024-09-06T15:13:01.135008+0000","last_active":"2024-09-06T15:13:50.225903+0000","last_peered":"2024-09-06T15:13:50.225903+0000","last_clean":"2024-09-06T15:13:50.225903+0000","last_became_active":"2024-09-06T15:13:01.134337+0000","last_became_peered":"2024-09-06T15:13:01.134337+0000","last_unstale":"2024-09-06T15:13:50.225903+0000","last_undegraded":"2024-09-06T15:13:50.225903+0000","last_fullsized":"2024-09-06T15:13:50.225903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:15:37.161154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"60'4","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228501+0000","last_change":"2024-09-06T15:12:57.099940+0000","last_active":"2024-09-06T15:13:50.228501+0000","last_peered":"2024-09-06T15:13:50.228501+0000","last_clean":"2024-09-06T15:13:50.228501+0000","last_became_active":"2024-09-06T15:12:57.099634+0000","last_became_peered":"2024-09-06T15:12:57.099634+0000","last_unstale":"2024-09-06T15:13:50.228501+0000","last_undegraded":"2024-09-06T15:13:50.228501+0000","last_fullsized":"2024-09-06T15:13:50.228501+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:57:23.297365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232433+0000","last_change":"2024-09-06T15:12:55.104441+0000","last_active":"2024-09-06T15:13:50.232433+0000","last_peered":"2024-09-06T15:13:50.232433+0000","last_clean":"2024-09-06T15:13:50.232433+0000","last_became_active":"2024-09-06T15:12:55.103145+0000","last_became_peered":"2024-09-06T15:12:55.103145+0000","last_unstale":"2024-09-06T15:13:50.232433+0000","last_undegraded":"2024-09-06T15:13:50.232433+0000","last_fullsized":"2024-09-06T15:13:50.232433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:42:58.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234079+0000","last_change":"2024-09-06T15:12:59.131881+0000","last_active":"2024-09-06T15:13:50.234079+0000","last_peered":"2024-09-06T15:13:50.234079+0000","last_clean":"2024-09-06T15:13:50.234079+0000","last_became_active":"2024-09-06T15:12:59.131203+0000","last_became_peered":"2024-09-06T15:12:59.131203+0000","last_unstale":"2024-09-06T15:13:50.234079+0000","last_undegraded":"2024-09-06T15:13:50.234079+0000","last_fullsized":"2024-09-06T15:13:50.234079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:22:39.411261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230263+0000","last_change":"2024-09-06T15:13:01.198622+0000","last_active":"2024-09-06T15:13:50.230263+0000","last_peered":"2024-09-06T15:13:50.230263+0000","last_clean":"2024-09-06T15:13:50.230263+0000","last_became_active":"2024-09-06T15:13:01.197834+0000","last_became_peered":"2024-09-06T15:13:01.197834+0000","last_unstale":"2024-09-06T15:13:50.230263+0000","last_undegraded":"2024-09-06T15:13:50.230263+0000","last_fullsized":"2024-09-06T15:13:50.230263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:55:43.457108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230721+0000","last_change":"2024-09-06T15:12:57.354614+0000","last_active":"2024-09-06T15:13:50.230721+0000","last_peered":"2024-09-06T15:13:50.230721+0000","last_clean":"2024-09-06T15:13:50.230721+0000","last_became_active":"2024-09-06T15:12:57.353708+0000","last_became_peered":"2024-09-06T15:12:57.353708+0000","last_unstale":"2024-09-06T15:13:50.230721+0000","last_undegraded":"2024-09-06T15:13:50.230721+0000","last_fullsized":"2024-09-06T15:13:50.230721+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:56:00.645313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229846+0000","last_change":"2024-09-06T15:12:55.122768+0000","last_active":"2024-09-06T15:13:50.229846+0000","last_peered":"2024-09-06T15:13:50.229846+0000","last_clean":"2024-09-06T15:13:50.229846+0000","last_became_active":"2024-09-06T15:12:55.121959+0000","last_became_peered":"2024-09-06T15:12:55.121959+0000","last_unstale":"2024-09-06T15:13:50.229846+0000","last_undegraded":"2024-09-06T15:13:50.229846+0000","last_fullsized":"2024-09-06T15:13:50.229846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:16:00.981758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"60'11","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.278630+0000","last_change":"2024-09-06T15:12:59.134504+0000","last_active":"2024-09-06T15:15:00.278630+0000","last_peered":"2024-09-06T15:15:00.278630+0000","last_clean":"2024-09-06T15:15:00.278630+0000","last_became_active":"2024-09-06T15:12:59.133969+0000","last_became_peered":"2024-09-06T15:12:59.133969+0000","last_unstale":"2024-09-06T15:15:00.278630+0000","last_undegraded":"2024-09-06T15:15:00.278630+0000","last_fullsized":"2024-09-06T15:15:00.278630+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:35.369447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225585+0000","last_change":"2024-09-06T15:13:01.129732+0000","last_active":"2024-09-06T15:13:50.225585+0000","last_peered":"2024-09-06T15:13:50.225585+0000","last_clean":"2024-09-06T15:13:50.225585+0000","last_became_active":"2024-09-06T15:13:01.129052+0000","last_became_peered":"2024-09-06T15:13:01.129052+0000","last_unstale":"2024-09-06T15:13:50.225585+0000","last_undegraded":"2024-09-06T15:13:50.225585+0000","last_fullsized":"2024-09-06T15:13:50.225585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:43:08.774355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225751+0000","last_change":"2024-09-06T15:12:57.104512+0000","last_active":"2024-09-06T15:13:50.225751+0000","last_peered":"2024-09-06T15:13:50.225751+0000","last_clean":"2024-09-06T15:13:50.225751+0000","last_became_active":"2024-09-06T15:12:57.101428+0000","last_became_peered":"2024-09-06T15:12:57.101428+0000","last_unstale":"2024-09-06T15:13:50.225751+0000","last_undegraded":"2024-09-06T15:13:50.225751+0000","last_fullsized":"2024-09-06T15:13:50.225751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:22.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226640+0000","last_change":"2024-09-06T15:12:55.099713+0000","last_active":"2024-09-06T15:13:50.226640+0000","last_peered":"2024-09-06T15:13:50.226640+0000","last_clean":"2024-09-06T15:13:50.226640+0000","last_became_active":"2024-09-06T15:12:55.099396+0000","last_became_peered":"2024-09-06T15:12:55.099396+0000","last_unstale":"2024-09-06T15:13:50.226640+0000","last_undegraded":"2024-09-06T15:13:50.226640+0000","last_fullsized":"2024-09-06T15:13:50.226640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:31:17.642230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'11","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.275445+0000","last_change":"2024-09-06T15:12:59.128467+0000","last_active":"2024-09-06T15:15:00.275445+0000","last_peered":"2024-09-06T15:15:00.275445+0000","last_clean":"2024-09-06T15:15:00.275445+0000","last_became_active":"2024-09-06T15:12:59.128090+0000","last_became_peered":"2024-09-06T15:12:59.128090+0000","last_unstale":"2024-09-06T15:15:00.275445+0000","last_undegraded":"2024-09-06T15:15:00.275445+0000","last_fullsized":"2024-09-06T15:15:00.275445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:45:14.512010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"60'1","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772911+0000","last_change":"2024-09-06T15:13:01.122273+0000","last_active":"2024-09-06T15:13:49.772911+0000","last_peered":"2024-09-06T15:13:49.772911+0000","last_clean":"2024-09-06T15:13:49.772911+0000","last_became_active":"2024-09-06T15:13:01.121430+0000","last_became_peered":"2024-09-06T15:13:01.121430+0000","last_unstale":"2024-09-06T15:13:49.772911+0000","last_undegraded":"2024-09-06T15:13:49.772911+0000","last_fullsized":"2024-09-06T15:13:49.772911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:54:51.869566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230954+0000","last_change":"2024-09-06T15:12:57.107085+0000","last_active":"2024-09-06T15:13:50.230954+0000","last_peered":"2024-09-06T15:13:50.230954+0000","last_clean":"2024-09-06T15:13:50.230954+0000","last_became_active":"2024-09-06T15:12:57.106697+0000","last_became_peered":"2024-09-06T15:12:57.106697+0000","last_unstale":"2024-09-06T15:13:50.230954+0000","last_undegraded":"2024-09-06T15:13:50.230954+0000","last_fullsized":"2024-09-06T15:13:50.230954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:32:41.174765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232889+0000","last_change":"2024-09-06T15:12:55.112019+0000","last_active":"2024-09-06T15:13:50.232889+0000","last_peered":"2024-09-06T15:13:50.232889+0000","last_clean":"2024-09-06T15:13:50.232889+0000","last_became_active":"2024-09-06T15:12:55.110778+0000","last_became_peered":"2024-09-06T15:12:55.110778+0000","last_unstale":"2024-09-06T15:13:50.232889+0000","last_undegraded":"2024-09-06T15:13:50.232889+0000","last_fullsized":"2024-09-06T15:13:50.232889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:04:03.227167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151602+0000","last_change":"2024-09-06T15:12:59.106636+0000","last_active":"2024-09-06T15:13:50.151602+0000","last_peered":"2024-09-06T15:13:50.151602+0000","last_clean":"2024-09-06T15:13:50.151602+0000","last_became_active":"2024-09-06T15:12:59.105909+0000","last_became_peered":"2024-09-06T15:12:59.105909+0000","last_unstale":"2024-09-06T15:13:50.151602+0000","last_undegraded":"2024-09-06T15:13:50.151602+0000","last_fullsized":"2024-09-06T15:13:50.151602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:47:48.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225198+0000","last_change":"2024-09-06T15:13:01.134298+0000","last_active":"2024-09-06T15:13:50.225198+0000","last_peered":"2024-09-06T15:13:50.225198+0000","last_clean":"2024-09-06T15:13:50.225198+0000","last_became_active":"2024-09-06T15:13:01.133588+0000","last_became_peered":"2024-09-06T15:13:01.133588+0000","last_unstale":"2024-09-06T15:13:50.225198+0000","last_undegraded":"2024-09-06T15:13:50.225198+0000","last_fullsized":"2024-09-06T15:13:50.225198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:24:52.611458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'10","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772356+0000","last_change":"2024-09-06T15:12:57.096105+0000","last_active":"2024-09-06T15:13:49.772356+0000","last_peered":"2024-09-06T15:13:49.772356+0000","last_clean":"2024-09-06T15:13:49.772356+0000","last_became_active":"2024-09-06T15:12:57.095746+0000","last_became_peered":"2024-09-06T15:12:57.095746+0000","last_unstale":"2024-09-06T15:13:49.772356+0000","last_undegraded":"2024-09-06T15:13:49.772356+0000","last_fullsized":"2024-09-06T15:13:49.772356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:23:00.944712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775070+0000","last_change":"2024-09-06T15:12:55.101101+0000","last_active":"2024-09-06T15:13:49.775070+0000","last_peered":"2024-09-06T15:13:49.775070+0000","last_clean":"2024-09-06T15:13:49.775070+0000","last_became_active":"2024-09-06T15:12:55.100688+0000","last_became_peered":"2024-09-06T15:12:55.100688+0000","last_unstale":"2024-09-06T15:13:49.775070+0000","last_undegraded":"2024-09-06T15:13:49.775070+0000","last_fullsized":"2024-09-06T15:13:49.775070+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:08:00.126152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774132+0000","last_change":"2024-09-06T15:12:59.118330+0000","last_active":"2024-09-06T15:13:49.774132+0000","last_peered":"2024-09-06T15:13:49.774132+0000","last_clean":"2024-09-06T15:13:49.774132+0000","last_became_active":"2024-09-06T15:12:59.117626+0000","last_became_peered":"2024-09-06T15:12:59.117626+0000","last_unstale":"2024-09-06T15:13:49.774132+0000","last_undegraded":"2024-09-06T15:13:49.774132+0000","last_fullsized":"2024-09-06T15:13:49.774132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:26:21.876329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150249+0000","last_change":"2024-09-06T15:13:01.132081+0000","last_active":"2024-09-06T15:13:50.150249+0000","last_peered":"2024-09-06T15:13:50.150249+0000","last_clean":"2024-09-06T15:13:50.150249+0000","last_became_active":"2024-09-06T15:13:01.131292+0000","last_became_peered":"2024-09-06T15:13:01.131292+0000","last_unstale":"2024-09-06T15:13:50.150249+0000","last_undegraded":"2024-09-06T15:13:50.150249+0000","last_fullsized":"2024-09-06T15:13:50.150249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:29:22.387435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"60'6","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229012+0000","last_change":"2024-09-06T15:12:57.093851+0000","last_active":"2024-09-06T15:13:50.229012+0000","last_peered":"2024-09-06T15:13:50.229012+0000","last_clean":"2024-09-06T15:13:50.229012+0000","last_became_active":"2024-09-06T15:12:57.091853+0000","last_became_peered":"2024-09-06T15:12:57.091853+0000","last_unstale":"2024-09-06T15:13:50.229012+0000","last_undegraded":"2024-09-06T15:13:50.229012+0000","last_fullsized":"2024-09-06T15:13:50.229012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:03:14.928584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234462+0000","last_change":"2024-09-06T15:12:55.113462+0000","last_active":"2024-09-06T15:13:50.234462+0000","last_peered":"2024-09-06T15:13:50.234462+0000","last_clean":"2024-09-06T15:13:50.234462+0000","last_became_active":"2024-09-06T15:12:55.112658+0000","last_became_peered":"2024-09-06T15:12:55.112658+0000","last_unstale":"2024-09-06T15:13:50.234462+0000","last_undegraded":"2024-09-06T15:13:50.234462+0000","last_fullsized":"2024-09-06T15:13:50.234462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:51:54.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231596+0000","last_change":"2024-09-06T15:12:59.121520+0000","last_active":"2024-09-06T15:13:50.231596+0000","last_peered":"2024-09-06T15:13:50.231596+0000","last_clean":"2024-09-06T15:13:50.231596+0000","last_became_active":"2024-09-06T15:12:59.120484+0000","last_became_peered":"2024-09-06T15:12:59.120484+0000","last_unstale":"2024-09-06T15:13:50.231596+0000","last_undegraded":"2024-09-06T15:13:50.231596+0000","last_fullsized":"2024-09-06T15:13:50.231596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:51:14.841983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228768+0000","last_change":"2024-09-06T15:13:01.137270+0000","last_active":"2024-09-06T15:13:50.228768+0000","last_peered":"2024-09-06T15:13:50.228768+0000","last_clean":"2024-09-06T15:13:50.228768+0000","last_became_active":"2024-09-06T15:13:01.136578+0000","last_became_peered":"2024-09-06T15:13:01.136578+0000","last_unstale":"2024-09-06T15:13:50.228768+0000","last_undegraded":"2024-09-06T15:13:50.228768+0000","last_fullsized":"2024-09-06T15:13:50.228768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:59:58.520267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234213+0000","last_change":"2024-09-06T15:12:57.099201+0000","last_active":"2024-09-06T15:13:50.234213+0000","last_peered":"2024-09-06T15:13:50.234213+0000","last_clean":"2024-09-06T15:13:50.234213+0000","last_became_active":"2024-09-06T15:12:57.098738+0000","last_became_peered":"2024-09-06T15:12:57.098738+0000","last_unstale":"2024-09-06T15:13:50.234213+0000","last_undegraded":"2024-09-06T15:13:50.234213+0000","last_fullsized":"2024-09-06T15:13:50.234213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:19:04.262321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233297+0000","last_change":"2024-09-06T15:12:55.106875+0000","last_active":"2024-09-06T15:13:50.233297+0000","last_peered":"2024-09-06T15:13:50.233297+0000","last_clean":"2024-09-06T15:13:50.233297+0000","last_became_active":"2024-09-06T15:12:55.105653+0000","last_became_peered":"2024-09-06T15:12:55.105653+0000","last_unstale":"2024-09-06T15:13:50.233297+0000","last_undegraded":"2024-09-06T15:13:50.233297+0000","last_fullsized":"2024-09-06T15:13:50.233297+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:46:49.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229510+0000","last_change":"2024-09-06T15:12:59.114454+0000","last_active":"2024-09-06T15:13:50.229510+0000","last_peered":"2024-09-06T15:13:50.229510+0000","last_clean":"2024-09-06T15:13:50.229510+0000","last_became_active":"2024-09-06T15:12:59.109245+0000","last_became_peered":"2024-09-06T15:12:59.109245+0000","last_unstale":"2024-09-06T15:13:50.229510+0000","last_undegraded":"2024-09-06T15:13:50.229510+0000","last_fullsized":"2024-09-06T15:13:50.229510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:05:34.071027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151630+0000","last_change":"2024-09-06T15:13:01.196606+0000","last_active":"2024-09-06T15:13:50.151630+0000","last_peered":"2024-09-06T15:13:50.151630+0000","last_clean":"2024-09-06T15:13:50.151630+0000","last_became_active":"2024-09-06T15:13:01.195700+0000","last_became_peered":"2024-09-06T15:13:01.195700+0000","last_unstale":"2024-09-06T15:13:50.151630+0000","last_undegraded":"2024-09-06T15:13:50.151630+0000","last_fullsized":"2024-09-06T15:13:50.151630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:28:27.876206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":30,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230430+0000","last_change":"2024-09-06T15:13:01.141804+0000","last_active":"2024-09-06T15:13:50.230430+0000","last_peered":"2024-09-06T15:13:50.230430+0000","last_clean":"2024-09-06T15:13:50.230430+0000","last_became_active":"2024-09-06T15:13:01.140780+0000","last_became_peered":"2024-09-06T15:13:01.140780+0000","last_unstale":"2024-09-06T15:13:50.230430+0000","last_undegraded":"2024-09-06T15:13:50.230430+0000","last_fullsized":"2024-09-06T15:13:50.230430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:56:18.460079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775958+0000","last_change":"2024-09-06T15:12:57.121901+0000","last_active":"2024-09-06T15:13:49.775958+0000","last_peered":"2024-09-06T15:13:49.775958+0000","last_clean":"2024-09-06T15:13:49.775958+0000","last_became_active":"2024-09-06T15:12:57.120980+0000","last_became_peered":"2024-09-06T15:12:57.120980+0000","last_unstale":"2024-09-06T15:13:49.775958+0000","last_undegraded":"2024-09-06T15:13:49.775958+0000","last_fullsized":"2024-09-06T15:13:49.775958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:04:49.827286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228562+0000","last_change":"2024-09-06T15:12:55.119418+0000","last_active":"2024-09-06T15:13:50.228562+0000","last_peered":"2024-09-06T15:13:50.228562+0000","last_clean":"2024-09-06T15:13:50.228562+0000","last_became_active":"2024-09-06T15:12:55.118298+0000","last_became_peered":"2024-09-06T15:12:55.118298+0000","last_unstale":"2024-09-06T15:13:50.228562+0000","last_undegraded":"2024-09-06T15:13:50.228562+0000","last_fullsized":"2024-09-06T15:13:50.228562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:06:36.354696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"60'11","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:00.795747+0000","last_change":"2024-09-06T15:12:59.111941+0000","last_active":"2024-09-06T15:15:00.795747+0000","last_peered":"2024-09-06T15:15:00.795747+0000","last_clean":"2024-09-06T15:15:00.795747+0000","last_became_active":"2024-09-06T15:12:59.111010+0000","last_became_peered":"2024-09-06T15:12:59.111010+0000","last_unstale":"2024-09-06T15:15:00.795747+0000","last_undegraded":"2024-09-06T15:15:00.795747+0000","last_fullsized":"2024-09-06T15:15:00.795747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:24:35.622589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774750+0000","last_change":"2024-09-06T15:13:01.123847+0000","last_active":"2024-09-06T15:13:49.774750+0000","last_peered":"2024-09-06T15:13:49.774750+0000","last_clean":"2024-09-06T15:13:49.774750+0000","last_became_active":"2024-09-06T15:13:01.123092+0000","last_became_peered":"2024-09-06T15:13:01.123092+0000","last_unstale":"2024-09-06T15:13:49.774750+0000","last_undegraded":"2024-09-06T15:13:49.774750+0000","last_fullsized":"2024-09-06T15:13:49.774750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:46:31.052578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150368+0000","last_change":"2024-09-06T15:12:57.119447+0000","last_active":"2024-09-06T15:13:50.150368+0000","last_peered":"2024-09-06T15:13:50.150368+0000","last_clean":"2024-09-06T15:13:50.150368+0000","last_became_active":"2024-09-06T15:12:57.118724+0000","last_became_peered":"2024-09-06T15:12:57.118724+0000","last_unstale":"2024-09-06T15:13:50.150368+0000","last_undegraded":"2024-09-06T15:13:50.150368+0000","last_fullsized":"2024-09-06T15:13:50.150368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:51:22.172504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"53'1","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151388+0000","last_change":"2024-09-06T15:12:55.095167+0000","last_active":"2024-09-06T15:13:50.151388+0000","last_peered":"2024-09-06T15:13:50.151388+0000","last_clean":"2024-09-06T15:13:50.151388+0000","last_became_active":"2024-09-06T15:12:55.094818+0000","last_became_peered":"2024-09-06T15:12:55.094818+0000","last_unstale":"2024-09-06T15:13:50.151388+0000","last_undegraded":"2024-09-06T15:13:50.151388+0000","last_fullsized":"2024-09-06T15:13:50.151388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:41:05.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228357+0000","last_change":"2024-09-06T15:12:59.121442+0000","last_active":"2024-09-06T15:13:50.228357+0000","last_peered":"2024-09-06T15:13:50.228357+0000","last_clean":"2024-09-06T15:13:50.228357+0000","last_became_active":"2024-09-06T15:12:59.120880+0000","last_became_peered":"2024-09-06T15:12:59.120880+0000","last_unstale":"2024-09-06T15:13:50.228357+0000","last_undegraded":"2024-09-06T15:13:50.228357+0000","last_fullsized":"2024-09-06T15:13:50.228357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:39:27.657907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772856+0000","last_change":"2024-09-06T15:13:01.195000+0000","last_active":"2024-09-06T15:13:49.772856+0000","last_peered":"2024-09-06T15:13:49.772856+0000","last_clean":"2024-09-06T15:13:49.772856+0000","last_became_active":"2024-09-06T15:13:01.194129+0000","last_became_peered":"2024-09-06T15:13:01.194129+0000","last_unstale":"2024-09-06T15:13:49.772856+0000","last_undegraded":"2024-09-06T15:13:49.772856+0000","last_fullsized":"2024-09-06T15:13:49.772856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:29:37.556290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233047+0000","last_change":"2024-09-06T15:12:55.108548+0000","last_active":"2024-09-06T15:13:50.233047+0000","last_peered":"2024-09-06T15:13:50.233047+0000","last_clean":"2024-09-06T15:13:50.233047+0000","last_became_active":"2024-09-06T15:12:55.107721+0000","last_became_peered":"2024-09-06T15:12:55.107721+0000","last_unstale":"2024-09-06T15:13:50.233047+0000","last_undegraded":"2024-09-06T15:13:50.233047+0000","last_fullsized":"2024-09-06T15:13:50.233047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:41:30.930138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"60'5","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226428+0000","last_change":"2024-09-06T15:12:57.106815+0000","last_active":"2024-09-06T15:13:50.226428+0000","last_peered":"2024-09-06T15:13:50.226428+0000","last_clean":"2024-09-06T15:13:50.226428+0000","last_became_active":"2024-09-06T15:12:57.105252+0000","last_became_peered":"2024-09-06T15:12:57.105252+0000","last_unstale":"2024-09-06T15:13:50.226428+0000","last_undegraded":"2024-09-06T15:13:50.226428+0000","last_fullsized":"2024-09-06T15:13:50.226428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:37:48.590032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774976+0000","last_change":"2024-09-06T15:12:59.109861+0000","last_active":"2024-09-06T15:13:49.774976+0000","last_peered":"2024-09-06T15:13:49.774976+0000","last_clean":"2024-09-06T15:13:49.774976+0000","last_became_active":"2024-09-06T15:12:59.109111+0000","last_became_peered":"2024-09-06T15:12:59.109111+0000","last_unstale":"2024-09-06T15:13:49.774976+0000","last_undegraded":"2024-09-06T15:13:49.774976+0000","last_fullsized":"2024-09-06T15:13:49.774976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:45:03.165461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.152989+0000","last_change":"2024-09-06T15:13:01.193553+0000","last_active":"2024-09-06T15:13:50.152989+0000","last_peered":"2024-09-06T15:13:50.152989+0000","last_clean":"2024-09-06T15:13:50.152989+0000","last_became_active":"2024-09-06T15:13:01.192320+0000","last_became_peered":"2024-09-06T15:13:01.192320+0000","last_unstale":"2024-09-06T15:13:50.152989+0000","last_undegraded":"2024-09-06T15:13:50.152989+0000","last_fullsized":"2024-09-06T15:13:50.152989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:10:28.716755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151925+0000","last_change":"2024-09-06T15:12:55.097110+0000","last_active":"2024-09-06T15:13:50.151925+0000","last_peered":"2024-09-06T15:13:50.151925+0000","last_clean":"2024-09-06T15:13:50.151925+0000","last_became_active":"2024-09-06T15:12:55.096743+0000","last_became_peered":"2024-09-06T15:12:55.096743+0000","last_unstale":"2024-09-06T15:13:50.151925+0000","last_undegraded":"2024-09-06T15:13:50.151925+0000","last_fullsized":"2024-09-06T15:13:50.151925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:07:02.446347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772609+0000","last_change":"2024-09-06T15:12:57.354523+0000","last_active":"2024-09-06T15:13:49.772609+0000","last_peered":"2024-09-06T15:13:49.772609+0000","last_clean":"2024-09-06T15:13:49.772609+0000","last_became_active":"2024-09-06T15:12:57.353593+0000","last_became_peered":"2024-09-06T15:12:57.353593+0000","last_unstale":"2024-09-06T15:13:49.772609+0000","last_undegraded":"2024-09-06T15:13:49.772609+0000","last_fullsized":"2024-09-06T15:13:49.772609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:26:56.959785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771603+0000","last_change":"2024-09-06T15:12:59.131159+0000","last_active":"2024-09-06T15:13:49.771603+0000","last_peered":"2024-09-06T15:13:49.771603+0000","last_clean":"2024-09-06T15:13:49.771603+0000","last_became_active":"2024-09-06T15:12:59.130383+0000","last_became_peered":"2024-09-06T15:12:59.130383+0000","last_unstale":"2024-09-06T15:13:49.771603+0000","last_undegraded":"2024-09-06T15:13:49.771603+0000","last_fullsized":"2024-09-06T15:13:49.771603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:52:34.483945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397539,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1298432,"data_stored":850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593774,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716888,"statfs":{"total":95995035648,"available":95966093312,"internally_reserved":0,"allocated":1265664,"data_stored":849038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713296,"statfs":{"total":95995035648,"available":95962415104,"internally_reserved":0,"allocated":684032,"data_stored":260078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986244,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717420,"statfs":{"total":95995035648,"available":95966638080,"internally_reserved":0,"allocated":720896,"data_stored":260064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149773,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31848,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713304,"statfs":{"total":95995035648,"available":95962423296,"internally_reserved":0,"allocated":675840,"data_stored":260050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411417,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713300,"statfs":{"total":95995035648,"available":95962419200,"internally_reserved":0,"allocated":679936,"data_stored":259176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713292,"statfs":{"total":95995035648,"available":95962411008,"internally_reserved":0,"allocated":688128,"data_stored":259001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712704,"statfs":{"total":95995035648,"available":95961808896,"internally_reserved":0,"allocated":1290240,"data_stored":851122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-06T15:15:07.657 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph pg dump --format=json 2024-09-06T15:15:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[22757]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:08.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:14.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:14.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:08 smithi189 bash[29727]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:09 smithi189 bash[29727]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:09 smithi189 bash[29727]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:06.932752+0000 mgr.y (mgr.14631) 87 : audit [DBG] from='client.24671 v1:172.21.15.189:0/1904876070' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.314423+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.327560+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: cluster 2024-09-06T15:15:07.820805+0000 mgr.y (mgr.14631) 88 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.974536+0000 mon.c (mon.2) 80 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.975500+0000 mon.c (mon.2) 81 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:14.693 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.694 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:08 smithi190 bash[24979]: audit 2024-09-06T15:15:07.981990+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:15:14.694 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:09 smithi190 bash[24979]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.694 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:09 smithi190 bash[24979]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.694 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:09 smithi189 bash[22757]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.694 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:09 smithi189 bash[22757]: cluster 2024-09-06T15:15:09.821432+0000 mgr.y (mgr.14631) 89 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.694 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:10 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[29727]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[29727]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[29727]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[29727]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[22757]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.695 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[22757]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[22757]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:11 smithi189 bash[22757]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:11 smithi190 bash[24979]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:11 smithi190 bash[24979]: audit 2024-09-06T15:15:10.857406+0000 mgr.y (mgr.14631) 90 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:11 smithi190 bash[24979]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:11 smithi190 bash[24979]: cluster 2024-09-06T15:15:11.822991+0000 mgr.y (mgr.14631) 91 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:13 smithi190 bash[24979]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.696 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:13 smithi190 bash[24979]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.696 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:14.697 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:15:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- 172.21.15.189:0/1443668409 >> v1:172.21.15.189:6790/0 conn(0x7fe0901028c0 legacy=0x7fe090102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- 172.21.15.189:0/1443668409 shutdown_connections 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- 172.21.15.189:0/1443668409 >> 172.21.15.189:0/1443668409 conn(0x7fe0900fe330 msgr2=0x7fe090100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- 172.21.15.189:0/1443668409 shutdown_connections 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- 172.21.15.189:0/1443668409 wait complete. 2024-09-06T15:15:14.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 Processor -- start 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- start start 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe0901a96f0 con 0x7fe09010b430 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe0901aa8f0 con 0x7fe0901028c0 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe096360640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe0901abaf0 con 0x7fe09010efd0 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe08f7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe09010b430 0x7fe0901a4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:54378/0 (socket says 172.21.15.189:54378) 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.697+0000 7fe08f7fe640 1 -- 172.21.15.189:0/1960803928 learned_addr learned my addr 172.21.15.189:0/1960803928 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674483636 0 0) 0x7fe0901a96f0 con 0x7fe09010b430 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe078003520 con 0x7fe09010b430 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228981447 0 0) 0x7fe0901abaf0 con 0x7fe09010efd0 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0901a96f0 con 0x7fe09010efd0 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748399351 0 0) 0x7fe0901aa8f0 con 0x7fe0901028c0 2024-09-06T15:15:14.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0901abaf0 con 0x7fe0901028c0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4260581548 0 0) 0x7fe078003520 con 0x7fe09010b430 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0901aa8f0 con 0x7fe09010b430 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe084001310 con 0x7fe09010b430 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 245828884 0 0) 0x7fe0901a96f0 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe078003520 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe080001b30 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3428923682 0 0) 0x7fe078003520 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 >> v1:172.21.15.190:6789/0 conn(0x7fe0901028c0 legacy=0x7fe090100560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 >> v1:172.21.15.189:6789/0 conn(0x7fe09010b430 legacy=0x7fe0901a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0901acd90 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0901abd20 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0901ac300 con 0x7fe09010efd0 2024-09-06T15:15:14.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe080002060 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe080004c50 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c0050b0 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe080003970 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.701+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe080093d80 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.705+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe08005cd00 con 0x7fe09010efd0 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.865+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 --> v1:172.21.15.189:6800/1420554776 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe07c000bc0 con 0x7fe078078360 2024-09-06T15:15:14.702 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.869+0000 7fe08d7fa640 1 -- 172.21.15.189:0/1960803928 <== mgr.14631 v1:172.21.15.189:6800/1420554776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+346473 (unknown 2965378022 0 1914958994) 0x7fe07c000bc0 con 0x7fe078078360 2024-09-06T15:15:14.704 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:14.707 INFO:teuthology.orchestra.run.smithi189.stderr:dumped all 2024-09-06T15:15:14.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.873+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe078078360 legacy=0x7fe07807a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:14.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.873+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 >> v1:172.21.15.189:6790/0 conn(0x7fe09010efd0 legacy=0x7fe0901a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:14.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.873+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 shutdown_connections 2024-09-06T15:15:14.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.873+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 >> 172.21.15.189:0/1960803928 conn(0x7fe0900fe330 msgr2=0x7fe090100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:14.708 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.877+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 shutdown_connections 2024-09-06T15:15:14.709 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:13.877+0000 7fe096360640 1 -- 172.21.15.189:0/1960803928 wait complete. 2024-09-06T15:15:14.709 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:13 smithi189 bash[22757]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.709 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:13 smithi189 bash[22757]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:13 smithi189 bash[29727]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:13 smithi189 bash[29727]: cluster 2024-09-06T15:15:13.823679+0000 mgr.y (mgr.14631) 92 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:14.710 INFO:teuthology.orchestra.run.smithi189.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-06T15:15:13.823311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596507,"num_objects":199,"num_object_clones":0,"num_object_copies":597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":980,"num_read_kb":837,"num_write":549,"num_write_kb":1673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244152,"kb_used_data":7132,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749717064,"statfs":{"total":767960285184,"available":767710273536,"internally_reserved":0,"allocated":7303168,"data_stored":3849345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005592"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150420+0000","last_change":"2024-09-06T15:13:01.196569+0000","last_active":"2024-09-06T15:13:50.150420+0000","last_peered":"2024-09-06T15:13:50.150420+0000","last_clean":"2024-09-06T15:13:50.150420+0000","last_became_active":"2024-09-06T15:13:01.195798+0000","last_became_peered":"2024-09-06T15:13:01.195798+0000","last_unstale":"2024-09-06T15:13:50.150420+0000","last_undegraded":"2024-09-06T15:13:50.150420+0000","last_fullsized":"2024-09-06T15:13:50.150420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:47:59.276759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229279+0000","last_change":"2024-09-06T15:12:55.093124+0000","last_active":"2024-09-06T15:13:50.229279+0000","last_peered":"2024-09-06T15:13:50.229279+0000","last_clean":"2024-09-06T15:13:50.229279+0000","last_became_active":"2024-09-06T15:12:55.092815+0000","last_became_peered":"2024-09-06T15:12:55.092815+0000","last_unstale":"2024-09-06T15:13:50.229279+0000","last_undegraded":"2024-09-06T15:13:50.229279+0000","last_fullsized":"2024-09-06T15:13:50.229279+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:57:32.109121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"60'10","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153103+0000","last_change":"2024-09-06T15:12:57.353450+0000","last_active":"2024-09-06T15:13:50.153103+0000","last_peered":"2024-09-06T15:13:50.153103+0000","last_clean":"2024-09-06T15:13:50.153103+0000","last_became_active":"2024-09-06T15:12:57.353198+0000","last_became_peered":"2024-09-06T15:12:57.353198+0000","last_unstale":"2024-09-06T15:13:50.153103+0000","last_undegraded":"2024-09-06T15:13:50.153103+0000","last_fullsized":"2024-09-06T15:13:50.153103+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:30:34.311820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771367+0000","last_change":"2024-09-06T15:12:59.108262+0000","last_active":"2024-09-06T15:13:49.771367+0000","last_peered":"2024-09-06T15:13:49.771367+0000","last_clean":"2024-09-06T15:13:49.771367+0000","last_became_active":"2024-09-06T15:12:59.107237+0000","last_became_peered":"2024-09-06T15:12:59.107237+0000","last_unstale":"2024-09-06T15:13:49.771367+0000","last_undegraded":"2024-09-06T15:13:49.771367+0000","last_fullsized":"2024-09-06T15:13:49.771367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:21:48.652675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"53'1","reported_seq":49,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153287+0000","last_change":"2024-09-06T15:12:55.091165+0000","last_active":"2024-09-06T15:13:50.153287+0000","last_peered":"2024-09-06T15:13:50.153287+0000","last_clean":"2024-09-06T15:13:50.153287+0000","last_became_active":"2024-09-06T15:12:55.090795+0000","last_became_peered":"2024-09-06T15:12:55.090795+0000","last_unstale":"2024-09-06T15:13:50.153287+0000","last_undegraded":"2024-09-06T15:13:50.153287+0000","last_fullsized":"2024-09-06T15:13:50.153287+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:33:27.042420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"60'11","reported_seq":56,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228908+0000","last_change":"2024-09-06T15:12:57.351942+0000","last_active":"2024-09-06T15:13:50.228908+0000","last_peered":"2024-09-06T15:13:50.228908+0000","last_clean":"2024-09-06T15:13:50.228908+0000","last_became_active":"2024-09-06T15:12:57.351660+0000","last_became_peered":"2024-09-06T15:12:57.351660+0000","last_unstale":"2024-09-06T15:13:50.228908+0000","last_undegraded":"2024-09-06T15:13:50.228908+0000","last_fullsized":"2024-09-06T15:13:50.228908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:08:20.670208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775764+0000","last_change":"2024-09-06T15:12:59.116167+0000","last_active":"2024-09-06T15:13:49.775764+0000","last_peered":"2024-09-06T15:13:49.775764+0000","last_clean":"2024-09-06T15:13:49.775764+0000","last_became_active":"2024-09-06T15:12:59.115609+0000","last_became_peered":"2024-09-06T15:12:59.115609+0000","last_unstale":"2024-09-06T15:13:49.775764+0000","last_undegraded":"2024-09-06T15:13:49.775764+0000","last_fullsized":"2024-09-06T15:13:49.775764+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:53:57.082267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772296+0000","last_change":"2024-09-06T15:13:01.123916+0000","last_active":"2024-09-06T15:13:49.772296+0000","last_peered":"2024-09-06T15:13:49.772296+0000","last_clean":"2024-09-06T15:13:49.772296+0000","last_became_active":"2024-09-06T15:13:01.120929+0000","last_became_peered":"2024-09-06T15:13:01.120929+0000","last_unstale":"2024-09-06T15:13:49.772296+0000","last_undegraded":"2024-09-06T15:13:49.772296+0000","last_fullsized":"2024-09-06T15:13:49.772296+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:50:16.306941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231457+0000","last_change":"2024-09-06T15:12:55.109408+0000","last_active":"2024-09-06T15:13:50.231457+0000","last_peered":"2024-09-06T15:13:50.231457+0000","last_clean":"2024-09-06T15:13:50.231457+0000","last_became_active":"2024-09-06T15:12:55.108529+0000","last_became_peered":"2024-09-06T15:12:55.108529+0000","last_unstale":"2024-09-06T15:13:50.231457+0000","last_undegraded":"2024-09-06T15:13:50.231457+0000","last_fullsized":"2024-09-06T15:13:50.231457+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:53:18.654600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230391+0000","last_change":"2024-09-06T15:12:57.100187+0000","last_active":"2024-09-06T15:13:50.230391+0000","last_peered":"2024-09-06T15:13:50.230391+0000","last_clean":"2024-09-06T15:13:50.230391+0000","last_became_active":"2024-09-06T15:12:57.099292+0000","last_became_peered":"2024-09-06T15:12:57.099292+0000","last_unstale":"2024-09-06T15:13:50.230391+0000","last_undegraded":"2024-09-06T15:13:50.230391+0000","last_fullsized":"2024-09-06T15:13:50.230391+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:38:33.847429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229065+0000","last_change":"2024-09-06T15:12:59.106266+0000","last_active":"2024-09-06T15:13:50.229065+0000","last_peered":"2024-09-06T15:13:50.229065+0000","last_clean":"2024-09-06T15:13:50.229065+0000","last_became_active":"2024-09-06T15:12:59.105374+0000","last_became_peered":"2024-09-06T15:12:59.105374+0000","last_unstale":"2024-09-06T15:13:50.229065+0000","last_undegraded":"2024-09-06T15:13:50.229065+0000","last_fullsized":"2024-09-06T15:13:50.229065+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:18:45.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229048+0000","last_change":"2024-09-06T15:13:01.124998+0000","last_active":"2024-09-06T15:13:50.229048+0000","last_peered":"2024-09-06T15:13:50.229048+0000","last_clean":"2024-09-06T15:13:50.229048+0000","last_became_active":"2024-09-06T15:13:01.124250+0000","last_became_peered":"2024-09-06T15:13:01.124250+0000","last_unstale":"2024-09-06T15:13:50.229048+0000","last_undegraded":"2024-09-06T15:13:50.229048+0000","last_fullsized":"2024-09-06T15:13:50.229048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:50:53.431785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231474+0000","last_change":"2024-09-06T15:12:55.118326+0000","last_active":"2024-09-06T15:13:50.231474+0000","last_peered":"2024-09-06T15:13:50.231474+0000","last_clean":"2024-09-06T15:13:50.231474+0000","last_became_active":"2024-09-06T15:12:55.117499+0000","last_became_peered":"2024-09-06T15:12:55.117499+0000","last_unstale":"2024-09-06T15:13:50.231474+0000","last_undegraded":"2024-09-06T15:13:50.231474+0000","last_fullsized":"2024-09-06T15:13:50.231474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:07:45.699349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"60'12","reported_seq":59,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233157+0000","last_change":"2024-09-06T15:12:57.096146+0000","last_active":"2024-09-06T15:13:50.233157+0000","last_peered":"2024-09-06T15:13:50.233157+0000","last_clean":"2024-09-06T15:13:50.233157+0000","last_became_active":"2024-09-06T15:12:57.095347+0000","last_became_peered":"2024-09-06T15:12:57.095347+0000","last_unstale":"2024-09-06T15:13:50.233157+0000","last_undegraded":"2024-09-06T15:13:50.233157+0000","last_fullsized":"2024-09-06T15:13:50.233157+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:23:26.562774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229562+0000","last_change":"2024-09-06T15:12:59.129850+0000","last_active":"2024-09-06T15:13:50.229562+0000","last_peered":"2024-09-06T15:13:50.229562+0000","last_clean":"2024-09-06T15:13:50.229562+0000","last_became_active":"2024-09-06T15:12:59.128959+0000","last_became_peered":"2024-09-06T15:12:59.128959+0000","last_unstale":"2024-09-06T15:13:50.229562+0000","last_undegraded":"2024-09-06T15:13:50.229562+0000","last_fullsized":"2024-09-06T15:13:50.229562+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:31.000370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225327+0000","last_change":"2024-09-06T15:13:01.134475+0000","last_active":"2024-09-06T15:13:50.225327+0000","last_peered":"2024-09-06T15:13:50.225327+0000","last_clean":"2024-09-06T15:13:50.225327+0000","last_became_active":"2024-09-06T15:13:01.133803+0000","last_became_peered":"2024-09-06T15:13:01.133803+0000","last_unstale":"2024-09-06T15:13:50.225327+0000","last_undegraded":"2024-09-06T15:13:50.225327+0000","last_fullsized":"2024-09-06T15:13:50.225327+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:55:00.074355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"60'19","reported_seq":68,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232593+0000","last_change":"2024-09-06T15:12:57.103675+0000","last_active":"2024-09-06T15:13:50.232593+0000","last_peered":"2024-09-06T15:13:50.232593+0000","last_clean":"2024-09-06T15:13:50.232593+0000","last_became_active":"2024-09-06T15:12:57.103363+0000","last_became_peered":"2024-09-06T15:12:57.103363+0000","last_unstale":"2024-09-06T15:13:50.232593+0000","last_undegraded":"2024-09-06T15:13:50.232593+0000","last_fullsized":"2024-09-06T15:13:50.232593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:42:11.938934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227410+0000","last_change":"2024-09-06T15:13:39.349491+0000","last_active":"2024-09-06T15:13:50.227410+0000","last_peered":"2024-09-06T15:13:50.227410+0000","last_clean":"2024-09-06T15:13:50.227410+0000","last_became_active":"2024-09-06T15:13:39.348882+0000","last_became_peered":"2024-09-06T15:13:39.348882+0000","last_unstale":"2024-09-06T15:13:50.227410+0000","last_undegraded":"2024-09-06T15:13:50.227410+0000","last_fullsized":"2024-09-06T15:13:50.227410+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:42:45.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,5],"acting":[2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774404+0000","last_change":"2024-09-06T15:12:59.107571+0000","last_active":"2024-09-06T15:13:49.774404+0000","last_peered":"2024-09-06T15:13:49.774404+0000","last_clean":"2024-09-06T15:13:49.774404+0000","last_became_active":"2024-09-06T15:12:59.105677+0000","last_became_peered":"2024-09-06T15:12:59.105677+0000","last_unstale":"2024-09-06T15:13:49.774404+0000","last_undegraded":"2024-09-06T15:13:49.774404+0000","last_fullsized":"2024-09-06T15:13:49.774404+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:30:58.244201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227368+0000","last_change":"2024-09-06T15:13:01.142271+0000","last_active":"2024-09-06T15:13:50.227368+0000","last_peered":"2024-09-06T15:13:50.227368+0000","last_clean":"2024-09-06T15:13:50.227368+0000","last_became_active":"2024-09-06T15:13:01.141670+0000","last_became_peered":"2024-09-06T15:13:01.141670+0000","last_unstale":"2024-09-06T15:13:50.227368+0000","last_undegraded":"2024-09-06T15:13:50.227368+0000","last_fullsized":"2024-09-06T15:13:50.227368+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:16:05.170823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151783+0000","last_change":"2024-09-06T15:12:57.096440+0000","last_active":"2024-09-06T15:13:50.151783+0000","last_peered":"2024-09-06T15:13:50.151783+0000","last_clean":"2024-09-06T15:13:50.151783+0000","last_became_active":"2024-09-06T15:12:57.095615+0000","last_became_peered":"2024-09-06T15:12:57.095615+0000","last_unstale":"2024-09-06T15:13:50.151783+0000","last_undegraded":"2024-09-06T15:13:50.151783+0000","last_fullsized":"2024-09-06T15:13:50.151783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:26:02.366170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774803+0000","last_change":"2024-09-06T15:12:55.097329+0000","last_active":"2024-09-06T15:13:49.774803+0000","last_peered":"2024-09-06T15:13:49.774803+0000","last_clean":"2024-09-06T15:13:49.774803+0000","last_became_active":"2024-09-06T15:12:55.096925+0000","last_became_peered":"2024-09-06T15:12:55.096925+0000","last_unstale":"2024-09-06T15:13:49.774803+0000","last_undegraded":"2024-09-06T15:13:49.774803+0000","last_fullsized":"2024-09-06T15:13:49.774803+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:43:43.362858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"60'11","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.279734+0000","last_change":"2024-09-06T15:12:59.112801+0000","last_active":"2024-09-06T15:15:05.279734+0000","last_peered":"2024-09-06T15:15:05.279734+0000","last_clean":"2024-09-06T15:15:05.279734+0000","last_became_active":"2024-09-06T15:12:59.111964+0000","last_became_peered":"2024-09-06T15:12:59.111964+0000","last_unstale":"2024-09-06T15:15:05.279734+0000","last_undegraded":"2024-09-06T15:15:05.279734+0000","last_fullsized":"2024-09-06T15:15:05.279734+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:17:46.951059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772032+0000","last_change":"2024-09-06T15:13:01.115586+0000","last_active":"2024-09-06T15:13:49.772032+0000","last_peered":"2024-09-06T15:13:49.772032+0000","last_clean":"2024-09-06T15:13:49.772032+0000","last_became_active":"2024-09-06T15:13:01.114440+0000","last_became_peered":"2024-09-06T15:13:01.114440+0000","last_unstale":"2024-09-06T15:13:49.772032+0000","last_undegraded":"2024-09-06T15:13:49.772032+0000","last_fullsized":"2024-09-06T15:13:49.772032+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:37:52.557829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"60'15","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150718+0000","last_change":"2024-09-06T15:12:57.102328+0000","last_active":"2024-09-06T15:13:50.150718+0000","last_peered":"2024-09-06T15:13:50.150718+0000","last_clean":"2024-09-06T15:13:50.150718+0000","last_became_active":"2024-09-06T15:12:57.100994+0000","last_became_peered":"2024-09-06T15:12:57.100994+0000","last_unstale":"2024-09-06T15:13:50.150718+0000","last_undegraded":"2024-09-06T15:13:50.150718+0000","last_fullsized":"2024-09-06T15:13:50.150718+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:33:30.988739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.776223+0000","last_change":"2024-09-06T15:12:55.095595+0000","last_active":"2024-09-06T15:13:49.776223+0000","last_peered":"2024-09-06T15:13:49.776223+0000","last_clean":"2024-09-06T15:13:49.776223+0000","last_became_active":"2024-09-06T15:12:55.095247+0000","last_became_peered":"2024-09-06T15:12:55.095247+0000","last_unstale":"2024-09-06T15:13:49.776223+0000","last_undegraded":"2024-09-06T15:13:49.776223+0000","last_fullsized":"2024-09-06T15:13:49.776223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:16:41.884452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"60'11","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.282953+0000","last_change":"2024-09-06T15:12:59.110250+0000","last_active":"2024-09-06T15:15:05.282953+0000","last_peered":"2024-09-06T15:15:05.282953+0000","last_clean":"2024-09-06T15:15:05.282953+0000","last_became_active":"2024-09-06T15:12:59.109147+0000","last_became_peered":"2024-09-06T15:12:59.109147+0000","last_unstale":"2024-09-06T15:15:05.282953+0000","last_undegraded":"2024-09-06T15:15:05.282953+0000","last_fullsized":"2024-09-06T15:15:05.282953+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:38:06.742551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228703+0000","last_change":"2024-09-06T15:13:01.135779+0000","last_active":"2024-09-06T15:13:50.228703+0000","last_peered":"2024-09-06T15:13:50.228703+0000","last_clean":"2024-09-06T15:13:50.228703+0000","last_became_active":"2024-09-06T15:13:01.135022+0000","last_became_peered":"2024-09-06T15:13:01.135022+0000","last_unstale":"2024-09-06T15:13:50.228703+0000","last_undegraded":"2024-09-06T15:13:50.228703+0000","last_fullsized":"2024-09-06T15:13:50.228703+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:05:45.214445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"60'12","reported_seq":60,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772345+0000","last_change":"2024-09-06T15:12:57.356101+0000","last_active":"2024-09-06T15:13:49.772345+0000","last_peered":"2024-09-06T15:13:49.772345+0000","last_clean":"2024-09-06T15:13:49.772345+0000","last_became_active":"2024-09-06T15:12:57.355106+0000","last_became_peered":"2024-09-06T15:12:57.355106+0000","last_unstale":"2024-09-06T15:13:49.772345+0000","last_undegraded":"2024-09-06T15:13:49.772345+0000","last_fullsized":"2024-09-06T15:13:49.772345+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:48:11.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232057+0000","last_change":"2024-09-06T15:12:55.104906+0000","last_active":"2024-09-06T15:13:50.232057+0000","last_peered":"2024-09-06T15:13:50.232057+0000","last_clean":"2024-09-06T15:13:50.232057+0000","last_became_active":"2024-09-06T15:12:55.104118+0000","last_became_peered":"2024-09-06T15:12:55.104118+0000","last_unstale":"2024-09-06T15:13:50.232057+0000","last_undegraded":"2024-09-06T15:13:50.232057+0000","last_fullsized":"2024-09-06T15:13:50.232057+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:58:55.713885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233525+0000","last_change":"2024-09-06T15:12:59.126725+0000","last_active":"2024-09-06T15:13:50.233525+0000","last_peered":"2024-09-06T15:13:50.233525+0000","last_clean":"2024-09-06T15:13:50.233525+0000","last_became_active":"2024-09-06T15:12:59.124707+0000","last_became_peered":"2024-09-06T15:12:59.124707+0000","last_unstale":"2024-09-06T15:13:50.233525+0000","last_undegraded":"2024-09-06T15:13:50.233525+0000","last_fullsized":"2024-09-06T15:13:50.233525+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:32:38.998719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151887+0000","last_change":"2024-09-06T15:13:01.196591+0000","last_active":"2024-09-06T15:13:50.151887+0000","last_peered":"2024-09-06T15:13:50.151887+0000","last_clean":"2024-09-06T15:13:50.151887+0000","last_became_active":"2024-09-06T15:13:01.195670+0000","last_became_peered":"2024-09-06T15:13:01.195670+0000","last_unstale":"2024-09-06T15:13:50.151887+0000","last_undegraded":"2024-09-06T15:13:50.151887+0000","last_fullsized":"2024-09-06T15:13:50.151887+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:49:48.311248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"60'12","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228541+0000","last_change":"2024-09-06T15:12:57.118391+0000","last_active":"2024-09-06T15:13:50.228541+0000","last_peered":"2024-09-06T15:13:50.228541+0000","last_clean":"2024-09-06T15:13:50.228541+0000","last_became_active":"2024-09-06T15:12:57.117639+0000","last_became_peered":"2024-09-06T15:12:57.117639+0000","last_unstale":"2024-09-06T15:13:50.228541+0000","last_undegraded":"2024-09-06T15:13:50.228541+0000","last_fullsized":"2024-09-06T15:13:50.228541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:32:30.210338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233588+0000","last_change":"2024-09-06T15:12:55.101415+0000","last_active":"2024-09-06T15:13:50.233588+0000","last_peered":"2024-09-06T15:13:50.233588+0000","last_clean":"2024-09-06T15:13:50.233588+0000","last_became_active":"2024-09-06T15:12:55.100471+0000","last_became_peered":"2024-09-06T15:12:55.100471+0000","last_unstale":"2024-09-06T15:13:50.233588+0000","last_undegraded":"2024-09-06T15:13:50.233588+0000","last_fullsized":"2024-09-06T15:13:50.233588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:43:55.396985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"61'1","reported_seq":43,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772338+0000","last_change":"2024-09-06T15:13:07.173640+0000","last_active":"2024-09-06T15:13:49.772338+0000","last_peered":"2024-09-06T15:13:49.772338+0000","last_clean":"2024-09-06T15:13:49.772338+0000","last_became_active":"2024-09-06T15:12:58.086331+0000","last_became_peered":"2024-09-06T15:12:58.086331+0000","last_unstale":"2024-09-06T15:13:49.772338+0000","last_undegraded":"2024-09-06T15:13:49.772338+0000","last_fullsized":"2024-09-06T15:13:49.772338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:12:46.881435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042015230000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"60'11","reported_seq":71,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.279759+0000","last_change":"2024-09-06T15:12:59.130405+0000","last_active":"2024-09-06T15:15:05.279759+0000","last_peered":"2024-09-06T15:15:05.279759+0000","last_clean":"2024-09-06T15:15:05.279759+0000","last_became_active":"2024-09-06T15:12:59.128274+0000","last_became_peered":"2024-09-06T15:12:59.128274+0000","last_unstale":"2024-09-06T15:15:05.279759+0000","last_undegraded":"2024-09-06T15:15:05.279759+0000","last_fullsized":"2024-09-06T15:15:05.279759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:39:47.880992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229648+0000","last_change":"2024-09-06T15:13:01.198352+0000","last_active":"2024-09-06T15:13:50.229648+0000","last_peered":"2024-09-06T15:13:50.229648+0000","last_clean":"2024-09-06T15:13:50.229648+0000","last_became_active":"2024-09-06T15:13:01.197458+0000","last_became_peered":"2024-09-06T15:13:01.197458+0000","last_unstale":"2024-09-06T15:13:50.229648+0000","last_undegraded":"2024-09-06T15:13:50.229648+0000","last_fullsized":"2024-09-06T15:13:50.229648+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:41:36.803582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"60'13","reported_seq":64,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153267+0000","last_change":"2024-09-06T15:12:57.099261+0000","last_active":"2024-09-06T15:13:50.153267+0000","last_peered":"2024-09-06T15:13:50.153267+0000","last_clean":"2024-09-06T15:13:50.153267+0000","last_became_active":"2024-09-06T15:12:57.098052+0000","last_became_peered":"2024-09-06T15:12:57.098052+0000","last_unstale":"2024-09-06T15:13:50.153267+0000","last_undegraded":"2024-09-06T15:13:50.153267+0000","last_fullsized":"2024-09-06T15:13:50.153267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:31:46.440736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"53'1","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775742+0000","last_change":"2024-09-06T15:12:55.092136+0000","last_active":"2024-09-06T15:13:49.775742+0000","last_peered":"2024-09-06T15:13:49.775742+0000","last_clean":"2024-09-06T15:13:49.775742+0000","last_became_active":"2024-09-06T15:12:55.091652+0000","last_became_peered":"2024-09-06T15:12:55.091652+0000","last_unstale":"2024-09-06T15:13:49.775742+0000","last_undegraded":"2024-09-06T15:13:49.775742+0000","last_fullsized":"2024-09-06T15:13:49.775742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:34:31.853590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"64'5","reported_seq":161,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:09.410361+0000","last_change":"2024-09-06T15:13:07.607659+0000","last_active":"2024-09-06T15:15:09.410361+0000","last_peered":"2024-09-06T15:15:09.410361+0000","last_clean":"2024-09-06T15:15:09.410361+0000","last_became_active":"2024-09-06T15:12:58.094980+0000","last_became_peered":"2024-09-06T15:12:58.094980+0000","last_unstale":"2024-09-06T15:15:09.410361+0000","last_undegraded":"2024-09-06T15:15:09.410361+0000","last_fullsized":"2024-09-06T15:15:09.410361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:33:10.005559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006319842,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771725+0000","last_change":"2024-09-06T15:12:59.125226+0000","last_active":"2024-09-06T15:13:49.771725+0000","last_peered":"2024-09-06T15:13:49.771725+0000","last_clean":"2024-09-06T15:13:49.771725+0000","last_became_active":"2024-09-06T15:12:59.124354+0000","last_became_peered":"2024-09-06T15:12:59.124354+0000","last_unstale":"2024-09-06T15:13:49.771725+0000","last_undegraded":"2024-09-06T15:13:49.771725+0000","last_fullsized":"2024-09-06T15:13:49.771725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:03:27.676005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772403+0000","last_change":"2024-09-06T15:13:01.143786+0000","last_active":"2024-09-06T15:13:49.772403+0000","last_peered":"2024-09-06T15:13:49.772403+0000","last_clean":"2024-09-06T15:13:49.772403+0000","last_became_active":"2024-09-06T15:13:01.142908+0000","last_became_peered":"2024-09-06T15:13:01.142908+0000","last_unstale":"2024-09-06T15:13:49.772403+0000","last_undegraded":"2024-09-06T15:13:49.772403+0000","last_fullsized":"2024-09-06T15:13:49.772403+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:54:49.552486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"60'30","reported_seq":115,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.279754+0000","last_change":"2024-09-06T15:12:57.351412+0000","last_active":"2024-09-06T15:15:05.279754+0000","last_peered":"2024-09-06T15:15:05.279754+0000","last_clean":"2024-09-06T15:15:05.279754+0000","last_became_active":"2024-09-06T15:12:57.351080+0000","last_became_peered":"2024-09-06T15:12:57.351080+0000","last_unstale":"2024-09-06T15:15:05.279754+0000","last_undegraded":"2024-09-06T15:15:05.279754+0000","last_fullsized":"2024-09-06T15:15:05.279754+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:24.303744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231808+0000","last_change":"2024-09-06T15:12:55.112289+0000","last_active":"2024-09-06T15:13:50.231808+0000","last_peered":"2024-09-06T15:13:50.231808+0000","last_clean":"2024-09-06T15:13:50.231808+0000","last_became_active":"2024-09-06T15:12:55.111439+0000","last_became_peered":"2024-09-06T15:12:55.111439+0000","last_unstale":"2024-09-06T15:13:50.231808+0000","last_undegraded":"2024-09-06T15:13:50.231808+0000","last_fullsized":"2024-09-06T15:13:50.231808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:04:05.006968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232117+0000","last_change":"2024-09-06T15:12:59.137041+0000","last_active":"2024-09-06T15:13:50.232117+0000","last_peered":"2024-09-06T15:13:50.232117+0000","last_clean":"2024-09-06T15:13:50.232117+0000","last_became_active":"2024-09-06T15:12:59.136465+0000","last_became_peered":"2024-09-06T15:12:59.136465+0000","last_unstale":"2024-09-06T15:13:50.232117+0000","last_undegraded":"2024-09-06T15:13:50.232117+0000","last_fullsized":"2024-09-06T15:13:50.232117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:22:50.495480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775624+0000","last_change":"2024-09-06T15:13:01.193132+0000","last_active":"2024-09-06T15:13:49.775624+0000","last_peered":"2024-09-06T15:13:49.775624+0000","last_clean":"2024-09-06T15:13:49.775624+0000","last_became_active":"2024-09-06T15:13:01.192052+0000","last_became_peered":"2024-09-06T15:13:01.192052+0000","last_unstale":"2024-09-06T15:13:49.775624+0000","last_undegraded":"2024-09-06T15:13:49.775624+0000","last_fullsized":"2024-09-06T15:13:49.775624+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:55:16.512402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'16","reported_seq":87,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.800987+0000","last_change":"2024-09-06T15:12:57.354749+0000","last_active":"2024-09-06T15:15:05.800987+0000","last_peered":"2024-09-06T15:15:05.800987+0000","last_clean":"2024-09-06T15:15:05.800987+0000","last_became_active":"2024-09-06T15:12:57.353904+0000","last_became_peered":"2024-09-06T15:12:57.353904+0000","last_unstale":"2024-09-06T15:15:05.800987+0000","last_undegraded":"2024-09-06T15:15:05.800987+0000","last_fullsized":"2024-09-06T15:15:05.800987+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:32:46.266782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774681+0000","last_change":"2024-09-06T15:12:55.088071+0000","last_active":"2024-09-06T15:13:49.774681+0000","last_peered":"2024-09-06T15:13:49.774681+0000","last_clean":"2024-09-06T15:13:49.774681+0000","last_became_active":"2024-09-06T15:12:55.087713+0000","last_became_peered":"2024-09-06T15:12:55.087713+0000","last_unstale":"2024-09-06T15:13:49.774681+0000","last_undegraded":"2024-09-06T15:13:49.774681+0000","last_fullsized":"2024-09-06T15:13:49.774681+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:16:04.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"63'2","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774411+0000","last_change":"2024-09-06T15:13:07.160379+0000","last_active":"2024-09-06T15:13:49.774411+0000","last_peered":"2024-09-06T15:13:49.774411+0000","last_clean":"2024-09-06T15:13:49.774411+0000","last_became_active":"2024-09-06T15:12:58.096521+0000","last_became_peered":"2024-09-06T15:12:58.096521+0000","last_unstale":"2024-09-06T15:13:49.774411+0000","last_undegraded":"2024-09-06T15:13:49.774411+0000","last_fullsized":"2024-09-06T15:13:49.774411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:57.070010+0000","last_clean_scrub_stamp":"2024-09-06T15:12:57.070010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:31:44.378001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001223165,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"60'11","reported_seq":71,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:10.283709+0000","last_change":"2024-09-06T15:12:59.119701+0000","last_active":"2024-09-06T15:15:10.283709+0000","last_peered":"2024-09-06T15:15:10.283709+0000","last_clean":"2024-09-06T15:15:10.283709+0000","last_became_active":"2024-09-06T15:12:59.118912+0000","last_became_peered":"2024-09-06T15:12:59.118912+0000","last_unstale":"2024-09-06T15:15:10.283709+0000","last_undegraded":"2024-09-06T15:15:10.283709+0000","last_fullsized":"2024-09-06T15:15:10.283709+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:11:40.386238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225497+0000","last_change":"2024-09-06T15:13:01.131691+0000","last_active":"2024-09-06T15:13:50.225497+0000","last_peered":"2024-09-06T15:13:50.225497+0000","last_clean":"2024-09-06T15:13:50.225497+0000","last_became_active":"2024-09-06T15:13:01.130754+0000","last_became_peered":"2024-09-06T15:13:01.130754+0000","last_unstale":"2024-09-06T15:13:50.225497+0000","last_undegraded":"2024-09-06T15:13:50.225497+0000","last_fullsized":"2024-09-06T15:13:50.225497+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:34:45.535565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"60'19","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771744+0000","last_change":"2024-09-06T15:12:57.096006+0000","last_active":"2024-09-06T15:13:49.771744+0000","last_peered":"2024-09-06T15:13:49.771744+0000","last_clean":"2024-09-06T15:13:49.771744+0000","last_became_active":"2024-09-06T15:12:57.095680+0000","last_became_peered":"2024-09-06T15:12:57.095680+0000","last_unstale":"2024-09-06T15:13:49.771744+0000","last_undegraded":"2024-09-06T15:13:49.771744+0000","last_fullsized":"2024-09-06T15:13:49.771744+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:41:48.387977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230238+0000","last_change":"2024-09-06T15:12:55.111796+0000","last_active":"2024-09-06T15:13:50.230238+0000","last_peered":"2024-09-06T15:13:50.230238+0000","last_clean":"2024-09-06T15:13:50.230238+0000","last_became_active":"2024-09-06T15:12:55.110987+0000","last_became_peered":"2024-09-06T15:12:55.110987+0000","last_unstale":"2024-09-06T15:13:50.230238+0000","last_undegraded":"2024-09-06T15:13:50.230238+0000","last_fullsized":"2024-09-06T15:13:50.230238+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:31:09.647656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227485+0000","last_change":"2024-09-06T15:12:59.112223+0000","last_active":"2024-09-06T15:13:50.227485+0000","last_peered":"2024-09-06T15:13:50.227485+0000","last_clean":"2024-09-06T15:13:50.227485+0000","last_became_active":"2024-09-06T15:12:59.111351+0000","last_became_peered":"2024-09-06T15:12:59.111351+0000","last_unstale":"2024-09-06T15:13:50.227485+0000","last_undegraded":"2024-09-06T15:13:50.227485+0000","last_fullsized":"2024-09-06T15:13:50.227485+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:12:35.386546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.152675+0000","last_change":"2024-09-06T15:13:01.145345+0000","last_active":"2024-09-06T15:13:50.152675+0000","last_peered":"2024-09-06T15:13:50.152675+0000","last_clean":"2024-09-06T15:13:50.152675+0000","last_became_active":"2024-09-06T15:13:01.144615+0000","last_became_peered":"2024-09-06T15:13:01.144615+0000","last_unstale":"2024-09-06T15:13:50.152675+0000","last_undegraded":"2024-09-06T15:13:50.152675+0000","last_fullsized":"2024-09-06T15:13:50.152675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:00:11.800063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"60'18","reported_seq":69,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775431+0000","last_change":"2024-09-06T15:12:57.351422+0000","last_active":"2024-09-06T15:13:49.775431+0000","last_peered":"2024-09-06T15:13:49.775431+0000","last_clean":"2024-09-06T15:13:49.775431+0000","last_became_active":"2024-09-06T15:12:57.351166+0000","last_became_peered":"2024-09-06T15:12:57.351166+0000","last_unstale":"2024-09-06T15:13:49.775431+0000","last_undegraded":"2024-09-06T15:13:49.775431+0000","last_fullsized":"2024-09-06T15:13:49.775431+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:18:59.755641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227421+0000","last_change":"2024-09-06T15:12:55.089677+0000","last_active":"2024-09-06T15:13:50.227421+0000","last_peered":"2024-09-06T15:13:50.227421+0000","last_clean":"2024-09-06T15:13:50.227421+0000","last_became_active":"2024-09-06T15:12:55.089262+0000","last_became_peered":"2024-09-06T15:12:55.089262+0000","last_unstale":"2024-09-06T15:13:50.227421+0000","last_undegraded":"2024-09-06T15:13:50.227421+0000","last_fullsized":"2024-09-06T15:13:50.227421+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:24:00.795821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227495+0000","last_change":"2024-09-06T15:12:59.112550+0000","last_active":"2024-09-06T15:13:50.227495+0000","last_peered":"2024-09-06T15:13:50.227495+0000","last_clean":"2024-09-06T15:13:50.227495+0000","last_became_active":"2024-09-06T15:12:59.111748+0000","last_became_peered":"2024-09-06T15:12:59.111748+0000","last_unstale":"2024-09-06T15:13:50.227495+0000","last_undegraded":"2024-09-06T15:13:50.227495+0000","last_fullsized":"2024-09-06T15:13:50.227495+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:50:52.905488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230631+0000","last_change":"2024-09-06T15:13:01.200713+0000","last_active":"2024-09-06T15:13:50.230631+0000","last_peered":"2024-09-06T15:13:50.230631+0000","last_clean":"2024-09-06T15:13:50.230631+0000","last_became_active":"2024-09-06T15:13:01.199889+0000","last_became_peered":"2024-09-06T15:13:01.199889+0000","last_unstale":"2024-09-06T15:13:50.230631+0000","last_undegraded":"2024-09-06T15:13:50.230631+0000","last_fullsized":"2024-09-06T15:13:50.230631+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:21:48.608030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"60'14","reported_seq":58,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227960+0000","last_change":"2024-09-06T15:12:57.105810+0000","last_active":"2024-09-06T15:13:50.227960+0000","last_peered":"2024-09-06T15:13:50.227960+0000","last_clean":"2024-09-06T15:13:50.227960+0000","last_became_active":"2024-09-06T15:12:57.104958+0000","last_became_peered":"2024-09-06T15:12:57.104958+0000","last_unstale":"2024-09-06T15:13:50.227960+0000","last_undegraded":"2024-09-06T15:13:50.227960+0000","last_fullsized":"2024-09-06T15:13:50.227960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:55:28.379123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232293+0000","last_change":"2024-09-06T15:12:55.096936+0000","last_active":"2024-09-06T15:13:50.232293+0000","last_peered":"2024-09-06T15:13:50.232293+0000","last_clean":"2024-09-06T15:13:50.232293+0000","last_became_active":"2024-09-06T15:12:55.095612+0000","last_became_peered":"2024-09-06T15:12:55.095612+0000","last_unstale":"2024-09-06T15:13:50.232293+0000","last_undegraded":"2024-09-06T15:13:50.232293+0000","last_fullsized":"2024-09-06T15:13:50.232293+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:15:53.279586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233708+0000","last_change":"2024-09-06T15:12:59.134094+0000","last_active":"2024-09-06T15:13:50.233708+0000","last_peered":"2024-09-06T15:13:50.233708+0000","last_clean":"2024-09-06T15:13:50.233708+0000","last_became_active":"2024-09-06T15:12:59.133552+0000","last_became_peered":"2024-09-06T15:12:59.133552+0000","last_unstale":"2024-09-06T15:13:50.233708+0000","last_undegraded":"2024-09-06T15:13:50.233708+0000","last_fullsized":"2024-09-06T15:13:50.233708+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:57:30.973206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774347+0000","last_change":"2024-09-06T15:13:01.139393+0000","last_active":"2024-09-06T15:13:49.774347+0000","last_peered":"2024-09-06T15:13:49.774347+0000","last_clean":"2024-09-06T15:13:49.774347+0000","last_became_active":"2024-09-06T15:13:01.138509+0000","last_became_peered":"2024-09-06T15:13:01.138509+0000","last_unstale":"2024-09-06T15:13:49.774347+0000","last_undegraded":"2024-09-06T15:13:49.774347+0000","last_fullsized":"2024-09-06T15:13:49.774347+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:50:37.575978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"60'10","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150810+0000","last_change":"2024-09-06T15:12:57.099104+0000","last_active":"2024-09-06T15:13:50.150810+0000","last_peered":"2024-09-06T15:13:50.150810+0000","last_clean":"2024-09-06T15:13:50.150810+0000","last_became_active":"2024-09-06T15:12:57.097862+0000","last_became_peered":"2024-09-06T15:12:57.097862+0000","last_unstale":"2024-09-06T15:13:50.150810+0000","last_undegraded":"2024-09-06T15:13:50.150810+0000","last_fullsized":"2024-09-06T15:13:50.150810+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:06:26.498012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231008+0000","last_change":"2024-09-06T15:12:55.122753+0000","last_active":"2024-09-06T15:13:50.231008+0000","last_peered":"2024-09-06T15:13:50.231008+0000","last_clean":"2024-09-06T15:13:50.231008+0000","last_became_active":"2024-09-06T15:12:55.121954+0000","last_became_peered":"2024-09-06T15:12:55.121954+0000","last_unstale":"2024-09-06T15:13:50.231008+0000","last_undegraded":"2024-09-06T15:13:50.231008+0000","last_fullsized":"2024-09-06T15:13:50.231008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:22:08.508140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"67'79","reported_seq":76,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:52.156256+0000","last_change":"2024-09-06T15:12:24.320138+0000","last_active":"2024-09-06T15:13:52.156256+0000","last_peered":"2024-09-06T15:13:52.156256+0000","last_clean":"2024-09-06T15:13:52.156256+0000","last_became_active":"2024-09-06T15:12:24.304986+0000","last_became_peered":"2024-09-06T15:12:24.304986+0000","last_unstale":"2024-09-06T15:13:52.156256+0000","last_undegraded":"2024-09-06T15:13:52.156256+0000","last_fullsized":"2024-09-06T15:13:52.156256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:07:52.568740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:07:52.568740+0000","last_clean_scrub_stamp":"2024-09-06T15:07:52.568740+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:35:50.913133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230829+0000","last_change":"2024-09-06T15:12:59.118099+0000","last_active":"2024-09-06T15:13:50.230829+0000","last_peered":"2024-09-06T15:13:50.230829+0000","last_clean":"2024-09-06T15:13:50.230829+0000","last_became_active":"2024-09-06T15:12:59.117143+0000","last_became_peered":"2024-09-06T15:12:59.117143+0000","last_unstale":"2024-09-06T15:13:50.230829+0000","last_undegraded":"2024-09-06T15:13:50.230829+0000","last_fullsized":"2024-09-06T15:13:50.230829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:48:18.712688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233435+0000","last_change":"2024-09-06T15:13:01.139470+0000","last_active":"2024-09-06T15:13:50.233435+0000","last_peered":"2024-09-06T15:13:50.233435+0000","last_clean":"2024-09-06T15:13:50.233435+0000","last_became_active":"2024-09-06T15:13:01.138815+0000","last_became_peered":"2024-09-06T15:13:01.138815+0000","last_unstale":"2024-09-06T15:13:50.233435+0000","last_undegraded":"2024-09-06T15:13:50.233435+0000","last_fullsized":"2024-09-06T15:13:50.233435+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:48:50.225517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"60'17","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231249+0000","last_change":"2024-09-06T15:12:57.105794+0000","last_active":"2024-09-06T15:13:50.231249+0000","last_peered":"2024-09-06T15:13:50.231249+0000","last_clean":"2024-09-06T15:13:50.231249+0000","last_became_active":"2024-09-06T15:12:57.105310+0000","last_became_peered":"2024-09-06T15:12:57.105310+0000","last_unstale":"2024-09-06T15:13:50.231249+0000","last_undegraded":"2024-09-06T15:13:50.231249+0000","last_fullsized":"2024-09-06T15:13:50.231249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:29:38.962498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226407+0000","last_change":"2024-09-06T15:12:55.092923+0000","last_active":"2024-09-06T15:13:50.226407+0000","last_peered":"2024-09-06T15:13:50.226407+0000","last_clean":"2024-09-06T15:13:50.226407+0000","last_became_active":"2024-09-06T15:12:55.091127+0000","last_became_peered":"2024-09-06T15:12:55.091127+0000","last_unstale":"2024-09-06T15:13:50.226407+0000","last_undegraded":"2024-09-06T15:13:50.226407+0000","last_fullsized":"2024-09-06T15:13:50.226407+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:24:26.113261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227620+0000","last_change":"2024-09-06T15:12:59.102301+0000","last_active":"2024-09-06T15:13:50.227620+0000","last_peered":"2024-09-06T15:13:50.227620+0000","last_clean":"2024-09-06T15:13:50.227620+0000","last_became_active":"2024-09-06T15:12:59.101826+0000","last_became_peered":"2024-09-06T15:12:59.101826+0000","last_unstale":"2024-09-06T15:13:50.227620+0000","last_undegraded":"2024-09-06T15:13:50.227620+0000","last_fullsized":"2024-09-06T15:13:50.227620+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:51:59.015592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232548+0000","last_change":"2024-09-06T15:13:01.146410+0000","last_active":"2024-09-06T15:13:50.232548+0000","last_peered":"2024-09-06T15:13:50.232548+0000","last_clean":"2024-09-06T15:13:50.232548+0000","last_became_active":"2024-09-06T15:13:01.145631+0000","last_became_peered":"2024-09-06T15:13:01.145631+0000","last_unstale":"2024-09-06T15:13:50.232548+0000","last_undegraded":"2024-09-06T15:13:50.232548+0000","last_fullsized":"2024-09-06T15:13:50.232548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:39:35.617066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"60'10","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230720+0000","last_change":"2024-09-06T15:12:57.098398+0000","last_active":"2024-09-06T15:13:50.230720+0000","last_peered":"2024-09-06T15:13:50.230720+0000","last_clean":"2024-09-06T15:13:50.230720+0000","last_became_active":"2024-09-06T15:12:57.098079+0000","last_became_peered":"2024-09-06T15:12:57.098079+0000","last_unstale":"2024-09-06T15:13:50.230720+0000","last_undegraded":"2024-09-06T15:13:50.230720+0000","last_fullsized":"2024-09-06T15:13:50.230720+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:14:40.693481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775184+0000","last_change":"2024-09-06T15:12:55.085708+0000","last_active":"2024-09-06T15:13:49.775184+0000","last_peered":"2024-09-06T15:13:49.775184+0000","last_clean":"2024-09-06T15:13:49.775184+0000","last_became_active":"2024-09-06T15:12:55.085406+0000","last_became_peered":"2024-09-06T15:12:55.085406+0000","last_unstale":"2024-09-06T15:13:49.775184+0000","last_undegraded":"2024-09-06T15:13:49.775184+0000","last_fullsized":"2024-09-06T15:13:49.775184+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:44:40.497860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225622+0000","last_change":"2024-09-06T15:12:59.120543+0000","last_active":"2024-09-06T15:13:50.225622+0000","last_peered":"2024-09-06T15:13:50.225622+0000","last_clean":"2024-09-06T15:13:50.225622+0000","last_became_active":"2024-09-06T15:12:59.120226+0000","last_became_peered":"2024-09-06T15:12:59.120226+0000","last_unstale":"2024-09-06T15:13:50.225622+0000","last_undegraded":"2024-09-06T15:13:50.225622+0000","last_fullsized":"2024-09-06T15:13:50.225622+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:05:02.253548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227767+0000","last_change":"2024-09-06T15:13:01.128764+0000","last_active":"2024-09-06T15:13:50.227767+0000","last_peered":"2024-09-06T15:13:50.227767+0000","last_clean":"2024-09-06T15:13:50.227767+0000","last_became_active":"2024-09-06T15:13:01.127887+0000","last_became_peered":"2024-09-06T15:13:01.127887+0000","last_unstale":"2024-09-06T15:13:50.227767+0000","last_undegraded":"2024-09-06T15:13:50.227767+0000","last_fullsized":"2024-09-06T15:13:50.227767+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:26:54.636621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229090+0000","last_change":"2024-09-06T15:12:57.113708+0000","last_active":"2024-09-06T15:13:50.229090+0000","last_peered":"2024-09-06T15:13:50.229090+0000","last_clean":"2024-09-06T15:13:50.229090+0000","last_became_active":"2024-09-06T15:12:57.113436+0000","last_became_peered":"2024-09-06T15:12:57.113436+0000","last_unstale":"2024-09-06T15:13:50.229090+0000","last_undegraded":"2024-09-06T15:13:50.229090+0000","last_fullsized":"2024-09-06T15:13:50.229090+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:51:23.773058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.227948+0000","last_change":"2024-09-06T15:12:55.096250+0000","last_active":"2024-09-06T15:13:50.227948+0000","last_peered":"2024-09-06T15:13:50.227948+0000","last_clean":"2024-09-06T15:13:50.227948+0000","last_became_active":"2024-09-06T15:12:55.095951+0000","last_became_peered":"2024-09-06T15:12:55.095951+0000","last_unstale":"2024-09-06T15:13:50.227948+0000","last_undegraded":"2024-09-06T15:13:50.227948+0000","last_fullsized":"2024-09-06T15:13:50.227948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:12:21.620719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"60'11","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.282954+0000","last_change":"2024-09-06T15:12:59.110950+0000","last_active":"2024-09-06T15:15:05.282954+0000","last_peered":"2024-09-06T15:15:05.282954+0000","last_clean":"2024-09-06T15:15:05.282954+0000","last_became_active":"2024-09-06T15:12:59.109075+0000","last_became_peered":"2024-09-06T15:12:59.109075+0000","last_unstale":"2024-09-06T15:15:05.282954+0000","last_undegraded":"2024-09-06T15:15:05.282954+0000","last_fullsized":"2024-09-06T15:15:05.282954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:08:46.878348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228868+0000","last_change":"2024-09-06T15:13:01.200431+0000","last_active":"2024-09-06T15:13:50.228868+0000","last_peered":"2024-09-06T15:13:50.228868+0000","last_clean":"2024-09-06T15:13:50.228868+0000","last_became_active":"2024-09-06T15:13:01.199431+0000","last_became_peered":"2024-09-06T15:13:01.199431+0000","last_unstale":"2024-09-06T15:13:50.228868+0000","last_undegraded":"2024-09-06T15:13:50.228868+0000","last_fullsized":"2024-09-06T15:13:50.228868+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:26:36.957254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232975+0000","last_change":"2024-09-06T15:12:57.118928+0000","last_active":"2024-09-06T15:13:50.232975+0000","last_peered":"2024-09-06T15:13:50.232975+0000","last_clean":"2024-09-06T15:13:50.232975+0000","last_became_active":"2024-09-06T15:12:57.118496+0000","last_became_peered":"2024-09-06T15:12:57.118496+0000","last_unstale":"2024-09-06T15:13:50.232975+0000","last_undegraded":"2024-09-06T15:13:50.232975+0000","last_fullsized":"2024-09-06T15:13:50.232975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:25:26.970615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"53'3","reported_seq":64,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.773850+0000","last_change":"2024-09-06T15:12:55.095140+0000","last_active":"2024-09-06T15:13:49.773850+0000","last_peered":"2024-09-06T15:13:49.773850+0000","last_clean":"2024-09-06T15:13:49.773850+0000","last_became_active":"2024-09-06T15:12:55.094181+0000","last_became_peered":"2024-09-06T15:12:55.094181+0000","last_unstale":"2024-09-06T15:13:49.773850+0000","last_undegraded":"2024-09-06T15:13:49.773850+0000","last_fullsized":"2024-09-06T15:13:49.773850+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:40:54.802365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.224854+0000","last_change":"2024-09-06T15:12:59.104127+0000","last_active":"2024-09-06T15:13:50.224854+0000","last_peered":"2024-09-06T15:13:50.224854+0000","last_clean":"2024-09-06T15:13:50.224854+0000","last_became_active":"2024-09-06T15:12:59.101623+0000","last_became_peered":"2024-09-06T15:12:59.101623+0000","last_unstale":"2024-09-06T15:13:50.224854+0000","last_undegraded":"2024-09-06T15:13:50.224854+0000","last_fullsized":"2024-09-06T15:13:50.224854+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:14:02.253146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150550+0000","last_change":"2024-09-06T15:13:01.146792+0000","last_active":"2024-09-06T15:13:50.150550+0000","last_peered":"2024-09-06T15:13:50.150550+0000","last_clean":"2024-09-06T15:13:50.150550+0000","last_became_active":"2024-09-06T15:13:01.145857+0000","last_became_peered":"2024-09-06T15:13:01.145857+0000","last_unstale":"2024-09-06T15:13:50.150550+0000","last_undegraded":"2024-09-06T15:13:50.150550+0000","last_fullsized":"2024-09-06T15:13:50.150550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:58:51.407295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229755+0000","last_change":"2024-09-06T15:12:57.104501+0000","last_active":"2024-09-06T15:13:50.229755+0000","last_peered":"2024-09-06T15:13:50.229755+0000","last_clean":"2024-09-06T15:13:50.229755+0000","last_became_active":"2024-09-06T15:12:57.104095+0000","last_became_peered":"2024-09-06T15:12:57.104095+0000","last_unstale":"2024-09-06T15:13:50.229755+0000","last_undegraded":"2024-09-06T15:13:50.229755+0000","last_fullsized":"2024-09-06T15:13:50.229755+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:49:18.304775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225139+0000","last_change":"2024-09-06T15:12:55.091773+0000","last_active":"2024-09-06T15:13:50.225139+0000","last_peered":"2024-09-06T15:13:50.225139+0000","last_clean":"2024-09-06T15:13:50.225139+0000","last_became_active":"2024-09-06T15:12:55.090636+0000","last_became_peered":"2024-09-06T15:12:55.090636+0000","last_unstale":"2024-09-06T15:13:50.225139+0000","last_undegraded":"2024-09-06T15:13:50.225139+0000","last_fullsized":"2024-09-06T15:13:50.225139+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:59:52.887859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153128+0000","last_change":"2024-09-06T15:12:59.129100+0000","last_active":"2024-09-06T15:13:50.153128+0000","last_peered":"2024-09-06T15:13:50.153128+0000","last_clean":"2024-09-06T15:13:50.153128+0000","last_became_active":"2024-09-06T15:12:59.128537+0000","last_became_peered":"2024-09-06T15:12:59.128537+0000","last_unstale":"2024-09-06T15:13:50.153128+0000","last_undegraded":"2024-09-06T15:13:50.153128+0000","last_fullsized":"2024-09-06T15:13:50.153128+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:42:33.530016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225903+0000","last_change":"2024-09-06T15:13:01.135008+0000","last_active":"2024-09-06T15:13:50.225903+0000","last_peered":"2024-09-06T15:13:50.225903+0000","last_clean":"2024-09-06T15:13:50.225903+0000","last_became_active":"2024-09-06T15:13:01.134337+0000","last_became_peered":"2024-09-06T15:13:01.134337+0000","last_unstale":"2024-09-06T15:13:50.225903+0000","last_undegraded":"2024-09-06T15:13:50.225903+0000","last_fullsized":"2024-09-06T15:13:50.225903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:15:37.161154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"60'4","reported_seq":42,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228501+0000","last_change":"2024-09-06T15:12:57.099940+0000","last_active":"2024-09-06T15:13:50.228501+0000","last_peered":"2024-09-06T15:13:50.228501+0000","last_clean":"2024-09-06T15:13:50.228501+0000","last_became_active":"2024-09-06T15:12:57.099634+0000","last_became_peered":"2024-09-06T15:12:57.099634+0000","last_unstale":"2024-09-06T15:13:50.228501+0000","last_undegraded":"2024-09-06T15:13:50.228501+0000","last_fullsized":"2024-09-06T15:13:50.228501+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:57:23.297365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232433+0000","last_change":"2024-09-06T15:12:55.104441+0000","last_active":"2024-09-06T15:13:50.232433+0000","last_peered":"2024-09-06T15:13:50.232433+0000","last_clean":"2024-09-06T15:13:50.232433+0000","last_became_active":"2024-09-06T15:12:55.103145+0000","last_became_peered":"2024-09-06T15:12:55.103145+0000","last_unstale":"2024-09-06T15:13:50.232433+0000","last_undegraded":"2024-09-06T15:13:50.232433+0000","last_fullsized":"2024-09-06T15:13:50.232433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:42:58.749528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234079+0000","last_change":"2024-09-06T15:12:59.131881+0000","last_active":"2024-09-06T15:13:50.234079+0000","last_peered":"2024-09-06T15:13:50.234079+0000","last_clean":"2024-09-06T15:13:50.234079+0000","last_became_active":"2024-09-06T15:12:59.131203+0000","last_became_peered":"2024-09-06T15:12:59.131203+0000","last_unstale":"2024-09-06T15:13:50.234079+0000","last_undegraded":"2024-09-06T15:13:50.234079+0000","last_fullsized":"2024-09-06T15:13:50.234079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:22:39.411261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230263+0000","last_change":"2024-09-06T15:13:01.198622+0000","last_active":"2024-09-06T15:13:50.230263+0000","last_peered":"2024-09-06T15:13:50.230263+0000","last_clean":"2024-09-06T15:13:50.230263+0000","last_became_active":"2024-09-06T15:13:01.197834+0000","last_became_peered":"2024-09-06T15:13:01.197834+0000","last_unstale":"2024-09-06T15:13:50.230263+0000","last_undegraded":"2024-09-06T15:13:50.230263+0000","last_fullsized":"2024-09-06T15:13:50.230263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:55:43.457108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"60'11","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230721+0000","last_change":"2024-09-06T15:12:57.354614+0000","last_active":"2024-09-06T15:13:50.230721+0000","last_peered":"2024-09-06T15:13:50.230721+0000","last_clean":"2024-09-06T15:13:50.230721+0000","last_became_active":"2024-09-06T15:12:57.353708+0000","last_became_peered":"2024-09-06T15:12:57.353708+0000","last_unstale":"2024-09-06T15:13:50.230721+0000","last_undegraded":"2024-09-06T15:13:50.230721+0000","last_fullsized":"2024-09-06T15:13:50.230721+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:56:00.645313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229846+0000","last_change":"2024-09-06T15:12:55.122768+0000","last_active":"2024-09-06T15:13:50.229846+0000","last_peered":"2024-09-06T15:13:50.229846+0000","last_clean":"2024-09-06T15:13:50.229846+0000","last_became_active":"2024-09-06T15:12:55.121959+0000","last_became_peered":"2024-09-06T15:12:55.121959+0000","last_unstale":"2024-09-06T15:13:50.229846+0000","last_undegraded":"2024-09-06T15:13:50.229846+0000","last_fullsized":"2024-09-06T15:13:50.229846+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:16:00.981758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"60'11","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.283211+0000","last_change":"2024-09-06T15:12:59.134504+0000","last_active":"2024-09-06T15:15:05.283211+0000","last_peered":"2024-09-06T15:15:05.283211+0000","last_clean":"2024-09-06T15:15:05.283211+0000","last_became_active":"2024-09-06T15:12:59.133969+0000","last_became_peered":"2024-09-06T15:12:59.133969+0000","last_unstale":"2024-09-06T15:15:05.283211+0000","last_undegraded":"2024-09-06T15:15:05.283211+0000","last_fullsized":"2024-09-06T15:15:05.283211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:35.369447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225585+0000","last_change":"2024-09-06T15:13:01.129732+0000","last_active":"2024-09-06T15:13:50.225585+0000","last_peered":"2024-09-06T15:13:50.225585+0000","last_clean":"2024-09-06T15:13:50.225585+0000","last_became_active":"2024-09-06T15:13:01.129052+0000","last_became_peered":"2024-09-06T15:13:01.129052+0000","last_unstale":"2024-09-06T15:13:50.225585+0000","last_undegraded":"2024-09-06T15:13:50.225585+0000","last_fullsized":"2024-09-06T15:13:50.225585+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:43:08.774355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225751+0000","last_change":"2024-09-06T15:12:57.104512+0000","last_active":"2024-09-06T15:13:50.225751+0000","last_peered":"2024-09-06T15:13:50.225751+0000","last_clean":"2024-09-06T15:13:50.225751+0000","last_became_active":"2024-09-06T15:12:57.101428+0000","last_became_peered":"2024-09-06T15:12:57.101428+0000","last_unstale":"2024-09-06T15:13:50.225751+0000","last_undegraded":"2024-09-06T15:13:50.225751+0000","last_fullsized":"2024-09-06T15:13:50.225751+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:57:22.405202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226640+0000","last_change":"2024-09-06T15:12:55.099713+0000","last_active":"2024-09-06T15:13:50.226640+0000","last_peered":"2024-09-06T15:13:50.226640+0000","last_clean":"2024-09-06T15:13:50.226640+0000","last_became_active":"2024-09-06T15:12:55.099396+0000","last_became_peered":"2024-09-06T15:12:55.099396+0000","last_unstale":"2024-09-06T15:13:50.226640+0000","last_undegraded":"2024-09-06T15:13:50.226640+0000","last_fullsized":"2024-09-06T15:13:50.226640+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:31:17.642230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"60'11","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.280596+0000","last_change":"2024-09-06T15:12:59.128467+0000","last_active":"2024-09-06T15:15:05.280596+0000","last_peered":"2024-09-06T15:15:05.280596+0000","last_clean":"2024-09-06T15:15:05.280596+0000","last_became_active":"2024-09-06T15:12:59.128090+0000","last_became_peered":"2024-09-06T15:12:59.128090+0000","last_unstale":"2024-09-06T15:15:05.280596+0000","last_undegraded":"2024-09-06T15:15:05.280596+0000","last_fullsized":"2024-09-06T15:15:05.280596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:45:14.512010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"60'1","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772911+0000","last_change":"2024-09-06T15:13:01.122273+0000","last_active":"2024-09-06T15:13:49.772911+0000","last_peered":"2024-09-06T15:13:49.772911+0000","last_clean":"2024-09-06T15:13:49.772911+0000","last_became_active":"2024-09-06T15:13:01.121430+0000","last_became_peered":"2024-09-06T15:13:01.121430+0000","last_unstale":"2024-09-06T15:13:49.772911+0000","last_undegraded":"2024-09-06T15:13:49.772911+0000","last_fullsized":"2024-09-06T15:13:49.772911+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:54:51.869566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230954+0000","last_change":"2024-09-06T15:12:57.107085+0000","last_active":"2024-09-06T15:13:50.230954+0000","last_peered":"2024-09-06T15:13:50.230954+0000","last_clean":"2024-09-06T15:13:50.230954+0000","last_became_active":"2024-09-06T15:12:57.106697+0000","last_became_peered":"2024-09-06T15:12:57.106697+0000","last_unstale":"2024-09-06T15:13:50.230954+0000","last_undegraded":"2024-09-06T15:13:50.230954+0000","last_fullsized":"2024-09-06T15:13:50.230954+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:32:41.174765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.232889+0000","last_change":"2024-09-06T15:12:55.112019+0000","last_active":"2024-09-06T15:13:50.232889+0000","last_peered":"2024-09-06T15:13:50.232889+0000","last_clean":"2024-09-06T15:13:50.232889+0000","last_became_active":"2024-09-06T15:12:55.110778+0000","last_became_peered":"2024-09-06T15:12:55.110778+0000","last_unstale":"2024-09-06T15:13:50.232889+0000","last_undegraded":"2024-09-06T15:13:50.232889+0000","last_fullsized":"2024-09-06T15:13:50.232889+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:04:03.227167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151602+0000","last_change":"2024-09-06T15:12:59.106636+0000","last_active":"2024-09-06T15:13:50.151602+0000","last_peered":"2024-09-06T15:13:50.151602+0000","last_clean":"2024-09-06T15:13:50.151602+0000","last_became_active":"2024-09-06T15:12:59.105909+0000","last_became_peered":"2024-09-06T15:12:59.105909+0000","last_unstale":"2024-09-06T15:13:50.151602+0000","last_undegraded":"2024-09-06T15:13:50.151602+0000","last_fullsized":"2024-09-06T15:13:50.151602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:47:48.384162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.225198+0000","last_change":"2024-09-06T15:13:01.134298+0000","last_active":"2024-09-06T15:13:50.225198+0000","last_peered":"2024-09-06T15:13:50.225198+0000","last_clean":"2024-09-06T15:13:50.225198+0000","last_became_active":"2024-09-06T15:13:01.133588+0000","last_became_peered":"2024-09-06T15:13:01.133588+0000","last_unstale":"2024-09-06T15:13:50.225198+0000","last_undegraded":"2024-09-06T15:13:50.225198+0000","last_fullsized":"2024-09-06T15:13:50.225198+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:24:52.611458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"60'10","reported_seq":51,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772356+0000","last_change":"2024-09-06T15:12:57.096105+0000","last_active":"2024-09-06T15:13:49.772356+0000","last_peered":"2024-09-06T15:13:49.772356+0000","last_clean":"2024-09-06T15:13:49.772356+0000","last_became_active":"2024-09-06T15:12:57.095746+0000","last_became_peered":"2024-09-06T15:12:57.095746+0000","last_unstale":"2024-09-06T15:13:49.772356+0000","last_undegraded":"2024-09-06T15:13:49.772356+0000","last_fullsized":"2024-09-06T15:13:49.772356+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:23:00.944712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775070+0000","last_change":"2024-09-06T15:12:55.101101+0000","last_active":"2024-09-06T15:13:49.775070+0000","last_peered":"2024-09-06T15:13:49.775070+0000","last_clean":"2024-09-06T15:13:49.775070+0000","last_became_active":"2024-09-06T15:12:55.100688+0000","last_became_peered":"2024-09-06T15:12:55.100688+0000","last_unstale":"2024-09-06T15:13:49.775070+0000","last_undegraded":"2024-09-06T15:13:49.775070+0000","last_fullsized":"2024-09-06T15:13:49.775070+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T21:08:00.126152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774132+0000","last_change":"2024-09-06T15:12:59.118330+0000","last_active":"2024-09-06T15:13:49.774132+0000","last_peered":"2024-09-06T15:13:49.774132+0000","last_clean":"2024-09-06T15:13:49.774132+0000","last_became_active":"2024-09-06T15:12:59.117626+0000","last_became_peered":"2024-09-06T15:12:59.117626+0000","last_unstale":"2024-09-06T15:13:49.774132+0000","last_undegraded":"2024-09-06T15:13:49.774132+0000","last_fullsized":"2024-09-06T15:13:49.774132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:26:21.876329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150249+0000","last_change":"2024-09-06T15:13:01.132081+0000","last_active":"2024-09-06T15:13:50.150249+0000","last_peered":"2024-09-06T15:13:50.150249+0000","last_clean":"2024-09-06T15:13:50.150249+0000","last_became_active":"2024-09-06T15:13:01.131292+0000","last_became_peered":"2024-09-06T15:13:01.131292+0000","last_unstale":"2024-09-06T15:13:50.150249+0000","last_undegraded":"2024-09-06T15:13:50.150249+0000","last_fullsized":"2024-09-06T15:13:50.150249+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:29:22.387435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"60'6","reported_seq":45,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229012+0000","last_change":"2024-09-06T15:12:57.093851+0000","last_active":"2024-09-06T15:13:50.229012+0000","last_peered":"2024-09-06T15:13:50.229012+0000","last_clean":"2024-09-06T15:13:50.229012+0000","last_became_active":"2024-09-06T15:12:57.091853+0000","last_became_peered":"2024-09-06T15:12:57.091853+0000","last_unstale":"2024-09-06T15:13:50.229012+0000","last_undegraded":"2024-09-06T15:13:50.229012+0000","last_fullsized":"2024-09-06T15:13:50.229012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:03:14.928584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234462+0000","last_change":"2024-09-06T15:12:55.113462+0000","last_active":"2024-09-06T15:13:50.234462+0000","last_peered":"2024-09-06T15:13:50.234462+0000","last_clean":"2024-09-06T15:13:50.234462+0000","last_became_active":"2024-09-06T15:12:55.112658+0000","last_became_peered":"2024-09-06T15:12:55.112658+0000","last_unstale":"2024-09-06T15:13:50.234462+0000","last_undegraded":"2024-09-06T15:13:50.234462+0000","last_fullsized":"2024-09-06T15:13:50.234462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:51:54.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.231596+0000","last_change":"2024-09-06T15:12:59.121520+0000","last_active":"2024-09-06T15:13:50.231596+0000","last_peered":"2024-09-06T15:13:50.231596+0000","last_clean":"2024-09-06T15:13:50.231596+0000","last_became_active":"2024-09-06T15:12:59.120484+0000","last_became_peered":"2024-09-06T15:12:59.120484+0000","last_unstale":"2024-09-06T15:13:50.231596+0000","last_undegraded":"2024-09-06T15:13:50.231596+0000","last_fullsized":"2024-09-06T15:13:50.231596+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:51:14.841983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228768+0000","last_change":"2024-09-06T15:13:01.137270+0000","last_active":"2024-09-06T15:13:50.228768+0000","last_peered":"2024-09-06T15:13:50.228768+0000","last_clean":"2024-09-06T15:13:50.228768+0000","last_became_active":"2024-09-06T15:13:01.136578+0000","last_became_peered":"2024-09-06T15:13:01.136578+0000","last_unstale":"2024-09-06T15:13:50.228768+0000","last_undegraded":"2024-09-06T15:13:50.228768+0000","last_fullsized":"2024-09-06T15:13:50.228768+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:59:58.520267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.234213+0000","last_change":"2024-09-06T15:12:57.099201+0000","last_active":"2024-09-06T15:13:50.234213+0000","last_peered":"2024-09-06T15:13:50.234213+0000","last_clean":"2024-09-06T15:13:50.234213+0000","last_became_active":"2024-09-06T15:12:57.098738+0000","last_became_peered":"2024-09-06T15:12:57.098738+0000","last_unstale":"2024-09-06T15:13:50.234213+0000","last_undegraded":"2024-09-06T15:13:50.234213+0000","last_fullsized":"2024-09-06T15:13:50.234213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:19:04.262321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233297+0000","last_change":"2024-09-06T15:12:55.106875+0000","last_active":"2024-09-06T15:13:50.233297+0000","last_peered":"2024-09-06T15:13:50.233297+0000","last_clean":"2024-09-06T15:13:50.233297+0000","last_became_active":"2024-09-06T15:12:55.105653+0000","last_became_peered":"2024-09-06T15:12:55.105653+0000","last_unstale":"2024-09-06T15:13:50.233297+0000","last_undegraded":"2024-09-06T15:13:50.233297+0000","last_fullsized":"2024-09-06T15:13:50.233297+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T20:46:49.986390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.229510+0000","last_change":"2024-09-06T15:12:59.114454+0000","last_active":"2024-09-06T15:13:50.229510+0000","last_peered":"2024-09-06T15:13:50.229510+0000","last_clean":"2024-09-06T15:13:50.229510+0000","last_became_active":"2024-09-06T15:12:59.109245+0000","last_became_peered":"2024-09-06T15:12:59.109245+0000","last_unstale":"2024-09-06T15:13:50.229510+0000","last_undegraded":"2024-09-06T15:13:50.229510+0000","last_fullsized":"2024-09-06T15:13:50.229510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:05:34.071027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151630+0000","last_change":"2024-09-06T15:13:01.196606+0000","last_active":"2024-09-06T15:13:50.151630+0000","last_peered":"2024-09-06T15:13:50.151630+0000","last_clean":"2024-09-06T15:13:50.151630+0000","last_became_active":"2024-09-06T15:13:01.195700+0000","last_became_peered":"2024-09-06T15:13:01.195700+0000","last_unstale":"2024-09-06T15:13:50.151630+0000","last_undegraded":"2024-09-06T15:13:50.151630+0000","last_fullsized":"2024-09-06T15:13:50.151630+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:28:27.876206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"60'1","reported_seq":30,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.230430+0000","last_change":"2024-09-06T15:13:01.141804+0000","last_active":"2024-09-06T15:13:50.230430+0000","last_peered":"2024-09-06T15:13:50.230430+0000","last_clean":"2024-09-06T15:13:50.230430+0000","last_became_active":"2024-09-06T15:13:01.140780+0000","last_became_peered":"2024-09-06T15:13:01.140780+0000","last_unstale":"2024-09-06T15:13:50.230430+0000","last_undegraded":"2024-09-06T15:13:50.230430+0000","last_fullsized":"2024-09-06T15:13:50.230430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:56:18.460079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"60'15","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.775958+0000","last_change":"2024-09-06T15:12:57.121901+0000","last_active":"2024-09-06T15:13:49.775958+0000","last_peered":"2024-09-06T15:13:49.775958+0000","last_clean":"2024-09-06T15:13:49.775958+0000","last_became_active":"2024-09-06T15:12:57.120980+0000","last_became_peered":"2024-09-06T15:12:57.120980+0000","last_unstale":"2024-09-06T15:13:49.775958+0000","last_undegraded":"2024-09-06T15:13:49.775958+0000","last_fullsized":"2024-09-06T15:13:49.775958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T19:04:49.827286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228562+0000","last_change":"2024-09-06T15:12:55.119418+0000","last_active":"2024-09-06T15:13:50.228562+0000","last_peered":"2024-09-06T15:13:50.228562+0000","last_clean":"2024-09-06T15:13:50.228562+0000","last_became_active":"2024-09-06T15:12:55.118298+0000","last_became_peered":"2024-09-06T15:12:55.118298+0000","last_unstale":"2024-09-06T15:13:50.228562+0000","last_undegraded":"2024-09-06T15:13:50.228562+0000","last_fullsized":"2024-09-06T15:13:50.228562+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:06:36.354696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1f","version":"60'11","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:15:05.282960+0000","last_change":"2024-09-06T15:12:59.111941+0000","last_active":"2024-09-06T15:15:05.282960+0000","last_peered":"2024-09-06T15:15:05.282960+0000","last_clean":"2024-09-06T15:15:05.282960+0000","last_became_active":"2024-09-06T15:12:59.111010+0000","last_became_peered":"2024-09-06T15:12:59.111010+0000","last_unstale":"2024-09-06T15:15:05.282960+0000","last_undegraded":"2024-09-06T15:15:05.282960+0000","last_fullsized":"2024-09-06T15:15:05.282960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:24:35.622589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774750+0000","last_change":"2024-09-06T15:13:01.123847+0000","last_active":"2024-09-06T15:13:49.774750+0000","last_peered":"2024-09-06T15:13:49.774750+0000","last_clean":"2024-09-06T15:13:49.774750+0000","last_became_active":"2024-09-06T15:13:01.123092+0000","last_became_peered":"2024-09-06T15:13:01.123092+0000","last_unstale":"2024-09-06T15:13:49.774750+0000","last_undegraded":"2024-09-06T15:13:49.774750+0000","last_fullsized":"2024-09-06T15:13:49.774750+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T23:46:31.052578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.150368+0000","last_change":"2024-09-06T15:12:57.119447+0000","last_active":"2024-09-06T15:13:50.150368+0000","last_peered":"2024-09-06T15:13:50.150368+0000","last_clean":"2024-09-06T15:13:50.150368+0000","last_became_active":"2024-09-06T15:12:57.118724+0000","last_became_peered":"2024-09-06T15:12:57.118724+0000","last_unstale":"2024-09-06T15:13:50.150368+0000","last_undegraded":"2024-09-06T15:13:50.150368+0000","last_fullsized":"2024-09-06T15:13:50.150368+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:51:22.172504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"53'1","reported_seq":41,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151388+0000","last_change":"2024-09-06T15:12:55.095167+0000","last_active":"2024-09-06T15:13:50.151388+0000","last_peered":"2024-09-06T15:13:50.151388+0000","last_clean":"2024-09-06T15:13:50.151388+0000","last_became_active":"2024-09-06T15:12:55.094818+0000","last_became_peered":"2024-09-06T15:12:55.094818+0000","last_unstale":"2024-09-06T15:13:50.151388+0000","last_undegraded":"2024-09-06T15:13:50.151388+0000","last_fullsized":"2024-09-06T15:13:50.151388+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:41:05.428522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.228357+0000","last_change":"2024-09-06T15:12:59.121442+0000","last_active":"2024-09-06T15:13:50.228357+0000","last_peered":"2024-09-06T15:13:50.228357+0000","last_clean":"2024-09-06T15:13:50.228357+0000","last_became_active":"2024-09-06T15:12:59.120880+0000","last_became_peered":"2024-09-06T15:12:59.120880+0000","last_unstale":"2024-09-06T15:13:50.228357+0000","last_undegraded":"2024-09-06T15:13:50.228357+0000","last_fullsized":"2024-09-06T15:13:50.228357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:39:27.657907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772856+0000","last_change":"2024-09-06T15:13:01.195000+0000","last_active":"2024-09-06T15:13:49.772856+0000","last_peered":"2024-09-06T15:13:49.772856+0000","last_clean":"2024-09-06T15:13:49.772856+0000","last_became_active":"2024-09-06T15:13:01.194129+0000","last_became_peered":"2024-09-06T15:13:01.194129+0000","last_unstale":"2024-09-06T15:13:49.772856+0000","last_undegraded":"2024-09-06T15:13:49.772856+0000","last_fullsized":"2024-09-06T15:13:49.772856+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:29:37.556290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.233047+0000","last_change":"2024-09-06T15:12:55.108548+0000","last_active":"2024-09-06T15:13:50.233047+0000","last_peered":"2024-09-06T15:13:50.233047+0000","last_clean":"2024-09-06T15:13:50.233047+0000","last_became_active":"2024-09-06T15:12:55.107721+0000","last_became_peered":"2024-09-06T15:12:55.107721+0000","last_unstale":"2024-09-06T15:13:50.233047+0000","last_undegraded":"2024-09-06T15:13:50.233047+0000","last_fullsized":"2024-09-06T15:13:50.233047+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T00:41:30.930138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"60'5","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.226428+0000","last_change":"2024-09-06T15:12:57.106815+0000","last_active":"2024-09-06T15:13:50.226428+0000","last_peered":"2024-09-06T15:13:50.226428+0000","last_clean":"2024-09-06T15:13:50.226428+0000","last_became_active":"2024-09-06T15:12:57.105252+0000","last_became_peered":"2024-09-06T15:12:57.105252+0000","last_unstale":"2024-09-06T15:13:50.226428+0000","last_undegraded":"2024-09-06T15:13:50.226428+0000","last_fullsized":"2024-09-06T15:13:50.226428+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T18:37:48.590032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.774976+0000","last_change":"2024-09-06T15:12:59.109861+0000","last_active":"2024-09-06T15:13:49.774976+0000","last_peered":"2024-09-06T15:13:49.774976+0000","last_clean":"2024-09-06T15:13:49.774976+0000","last_became_active":"2024-09-06T15:12:59.109111+0000","last_became_peered":"2024-09-06T15:12:59.109111+0000","last_unstale":"2024-09-06T15:13:49.774976+0000","last_undegraded":"2024-09-06T15:13:49.774976+0000","last_fullsized":"2024-09-06T15:13:49.774976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T22:45:03.165461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":29,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.153044+0000","last_change":"2024-09-06T15:13:01.193553+0000","last_active":"2024-09-06T15:13:50.153044+0000","last_peered":"2024-09-06T15:13:50.153044+0000","last_clean":"2024-09-06T15:13:50.153044+0000","last_became_active":"2024-09-06T15:13:01.192320+0000","last_became_peered":"2024-09-06T15:13:01.192320+0000","last_unstale":"2024-09-06T15:13:50.153044+0000","last_undegraded":"2024-09-06T15:13:50.153044+0000","last_fullsized":"2024-09-06T15:13:50.153044+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:13:00.079692+0000","last_clean_scrub_stamp":"2024-09-06T15:13:00.079692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T02:10:28.716755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:50.151925+0000","last_change":"2024-09-06T15:12:55.097110+0000","last_active":"2024-09-06T15:13:50.151925+0000","last_peered":"2024-09-06T15:13:50.151925+0000","last_clean":"2024-09-06T15:13:50.151925+0000","last_became_active":"2024-09-06T15:12:55.096743+0000","last_became_peered":"2024-09-06T15:12:55.096743+0000","last_unstale":"2024-09-06T15:13:50.151925+0000","last_undegraded":"2024-09-06T15:13:50.151925+0000","last_fullsized":"2024-09-06T15:13:50.151925+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:54.052550+0000","last_clean_scrub_stamp":"2024-09-06T15:12:54.052550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T17:07:02.446347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"60'9","reported_seq":52,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.772609+0000","last_change":"2024-09-06T15:12:57.354523+0000","last_active":"2024-09-06T15:13:49.772609+0000","last_peered":"2024-09-06T15:13:49.772609+0000","last_clean":"2024-09-06T15:13:49.772609+0000","last_became_active":"2024-09-06T15:12:57.353593+0000","last_became_peered":"2024-09-06T15:12:57.353593+0000","last_unstale":"2024-09-06T15:13:49.772609+0000","last_undegraded":"2024-09-06T15:13:49.772609+0000","last_fullsized":"2024-09-06T15:13:49.772609+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:56.067042+0000","last_clean_scrub_stamp":"2024-09-06T15:12:56.067042+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T15:26:56.959785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-06T15:13:49.771603+0000","last_change":"2024-09-06T15:12:59.131159+0000","last_active":"2024-09-06T15:13:49.771603+0000","last_peered":"2024-09-06T15:13:49.771603+0000","last_clean":"2024-09-06T15:13:49.771603+0000","last_became_active":"2024-09-06T15:12:59.130383+0000","last_became_peered":"2024-09-06T15:12:59.130383+0000","last_unstale":"2024-09-06T15:13:49.771603+0000","last_undegraded":"2024-09-06T15:13:49.771603+0000","last_fullsized":"2024-09-06T15:13:49.771603+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T15:12:58.073027+0000","last_clean_scrub_stamp":"2024-09-06T15:12:58.073027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T16:52:34.483945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":111,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28292,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716860,"statfs":{"total":95995035648,"available":95966064640,"internally_reserved":0,"allocated":1298432,"data_stored":850816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593775,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28264,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716888,"statfs":{"total":95995035648,"available":95966093312,"internally_reserved":0,"allocated":1265664,"data_stored":849038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713296,"statfs":{"total":95995035648,"available":95962415104,"internally_reserved":0,"allocated":684032,"data_stored":260078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717420,"statfs":{"total":95995035648,"available":95966638080,"internally_reserved":0,"allocated":720896,"data_stored":260064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149774,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31848,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713304,"statfs":{"total":95995035648,"available":95962423296,"internally_reserved":0,"allocated":675840,"data_stored":260050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411418,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713300,"statfs":{"total":95995035648,"available":95962419200,"internally_reserved":0,"allocated":679936,"data_stored":259176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713292,"statfs":{"total":95995035648,"available":95962411008,"internally_reserved":0,"allocated":688128,"data_stored":259001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712704,"statfs":{"total":95995035648,"available":95961808896,"internally_reserved":0,"allocated":1290240,"data_stored":851122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-06T15:15:14.716 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-06T15:15:14.716 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-06T15:15:14.716 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-06T15:15:14.716 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:15:15.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:14 smithi189 bash[22757]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:15.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:14 smithi189 bash[22757]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:14 smithi189 bash[29727]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:15.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:14 smithi189 bash[29727]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:15.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:14 smithi190 bash[24979]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:15.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:14 smithi190 bash[24979]: audit 2024-09-06T15:15:13.868398+0000 mgr.y (mgr.14631) 93 : audit [DBG] from='client.24677 v1:172.21.15.189:0/1960803928' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T15:15:16.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:15 smithi189 bash[22757]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:16.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:15 smithi189 bash[22757]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:16.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:15 smithi189 bash[29727]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:16.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:15 smithi189 bash[29727]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:16.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:15 smithi190 bash[24979]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:16.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:15 smithi190 bash[24979]: cluster 2024-09-06T15:15:15.825104+0000 mgr.y (mgr.14631) 94 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:18.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:17 smithi189 bash[22757]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:18.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:17 smithi189 bash[22757]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:17 smithi189 bash[29727]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:17 smithi189 bash[29727]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:18.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:17 smithi190 bash[24979]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:18.372 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:17 smithi190 bash[24979]: cluster 2024-09-06T15:15:17.825816+0000 mgr.y (mgr.14631) 95 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:19.524 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:20.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:19 smithi189 bash[22757]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:19 smithi189 bash[22757]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:19 smithi189 bash[29727]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:19 smithi189 bash[29727]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:19 smithi190 bash[24979]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:19 smithi190 bash[24979]: cluster 2024-09-06T15:15:19.826540+0000 mgr.y (mgr.14631) 96 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:20.792 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/1159515183 >> v1:172.21.15.189:6789/0 conn(0x7fc52c101280 legacy=0x7fc52c101660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:24.750 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/1159515183 shutdown_connections 2024-09-06T15:15:24.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/1159515183 >> 172.21.15.189:0/1159515183 conn(0x7fc52c078cc0 msgr2=0x7fc52c0790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:24.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/1159515183 shutdown_connections 2024-09-06T15:15:24.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/1159515183 wait complete. 2024-09-06T15:15:24.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 Processor -- start 2024-09-06T15:15:24.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- start start 2024-09-06T15:15:24.752 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:20 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:20 smithi190 bash[24979]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:20 smithi190 bash[24979]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:21 smithi190 bash[24979]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:23 smithi190 bash[24979]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:24.753 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:23 smithi190 bash[24979]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc52c10c810 con 0x7fc52c109a50 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc52c1a8920 con 0x7fc52c10d650 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc52c1a9b00 con 0x7fc52c101280 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc531974640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fc52c109a50 0x7fc52c1a2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:60418/0 (socket says 172.21.15.189:60418) 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc531974640 1 -- 172.21.15.189:0/2472850312 learned_addr learned my addr 172.21.15.189:0/2472850312 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc532175640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fc52c101280 0x7fc52c10bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:41228/0 (socket says 172.21.15.189:41228) 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660319181 0 0) 0x7fc52c1a9b00 con 0x7fc52c101280 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc518004630 con 0x7fc52c101280 2024-09-06T15:15:24.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112399503 0 0) 0x7fc52c10c810 con 0x7fc52c109a50 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc52c1a9b00 con 0x7fc52c109a50 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3279143260 0 0) 0x7fc518004630 con 0x7fc52c101280 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc52c10c810 con 0x7fc52c101280 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc528001af0 con 0x7fc52c101280 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597693026 0 0) 0x7fc52c1a8920 con 0x7fc52c10d650 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc518004630 con 0x7fc52c10d650 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1371861860 0 0) 0x7fc52c1a9b00 con 0x7fc52c109a50 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc52c1a8920 con 0x7fc52c109a50 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc51c001970 con 0x7fc52c109a50 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1802821165 0 0) 0x7fc52c10c810 con 0x7fc52c101280 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 >> v1:172.21.15.190:6789/0 conn(0x7fc52c10d650 legacy=0x7fc52c1a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:24.756 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 >> v1:172.21.15.189:6789/0 conn(0x7fc52c109a50 legacy=0x7fc52c1a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c1aad80 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c1a9cd0 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc52c1aa300 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fc528004680 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.797+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc528004f70 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.801+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc510005080 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.801+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fc528003800 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.801+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fc528094eb0 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:20.805+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fc52805de70 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.009+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc510005370 con 0x7fc52c101280 2024-09-06T15:15:24.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.009+0000 7fc5237fe640 1 -- 172.21.15.189:0/2472850312 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fc528061fe0 con 0x7fc52c101280 2024-09-06T15:15:24.758 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:24.758 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:15:24.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 >> v1:172.21.15.189:6800/1420554776 conn(0x7fc518078490 legacy=0x7fc51807a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:24.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 >> v1:172.21.15.189:6790/0 conn(0x7fc52c101280 legacy=0x7fc52c10bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:24.758 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 shutdown_connections 2024-09-06T15:15:24.759 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 >> 172.21.15.189:0/2472850312 conn(0x7fc52c078cc0 msgr2=0x7fc52c105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:24.759 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 shutdown_connections 2024-09-06T15:15:24.759 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:21.013+0000 7fc5343d9640 1 -- 172.21.15.189:0/2472850312 wait complete. 2024-09-06T15:15:24.759 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:20 smithi189 bash[22757]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.759 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:20 smithi189 bash[22757]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.759 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:20 smithi189 bash[29727]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.759 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:20 smithi189 bash[29727]: audit 2024-09-06T15:15:20.308236+0000 mon.c (mon.2) 82 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[22757]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: audit 2024-09-06T15:15:20.858739+0000 mgr.y (mgr.14631) 97 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.761 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: audit 2024-09-06T15:15:21.013503+0000 mon.c (mon.2) 83 : audit [DBG] from='client.? v1:172.21.15.189:0/2472850312' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:24.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:21 smithi189 bash[29727]: cluster 2024-09-06T15:15:21.828103+0000 mgr.y (mgr.14631) 98 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:24.762 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:15:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:15:24.762 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:23 smithi189 bash[22757]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:24.762 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:23 smithi189 bash[22757]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:24.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:23 smithi189 bash[29727]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:24.763 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:23 smithi189 bash[29727]: cluster 2024-09-06T15:15:23.828821+0000 mgr.y (mgr.14631) 99 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:26.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:25 smithi189 bash[22757]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:26.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:25 smithi189 bash[22757]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:26.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:25 smithi189 bash[29727]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:26.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:25 smithi189 bash[29727]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:26.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:25 smithi190 bash[24979]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:26.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:25 smithi190 bash[24979]: cluster 2024-09-06T15:15:25.830233+0000 mgr.y (mgr.14631) 100 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:27.761 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:15:28.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:27 smithi189 bash[22757]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:28.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:27 smithi189 bash[22757]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:28.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:27 smithi189 bash[29727]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:28.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:27 smithi189 bash[29727]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:28.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:27 smithi190 bash[24979]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:28.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:27 smithi190 bash[24979]: cluster 2024-09-06T15:15:27.830721+0000 mgr.y (mgr.14631) 101 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:29 smithi189 bash[22757]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:29 smithi189 bash[22757]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:29 smithi189 bash[29727]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:29 smithi189 bash[29727]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:29 smithi190 bash[24979]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:30.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:29 smithi190 bash[24979]: cluster 2024-09-06T15:15:29.831403+0000 mgr.y (mgr.14631) 102 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:31.120 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:30 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:32.167 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[22757]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[22757]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[22757]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[22757]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[29727]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[29727]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[29727]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:31 smithi189 bash[29727]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:31 smithi190 bash[24979]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:31 smithi190 bash[24979]: audit 2024-09-06T15:15:30.869926+0000 mgr.y (mgr.14631) 103 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:32.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:31 smithi190 bash[24979]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:31 smithi190 bash[24979]: cluster 2024-09-06T15:15:31.832929+0000 mgr.y (mgr.14631) 104 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:32.564 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:32.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:32 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:15:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:15:33.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/1520495874 >> v1:172.21.15.189:6790/0 conn(0x7f5cb41111e0 legacy=0x7f5cb41136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:33.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/1520495874 shutdown_connections 2024-09-06T15:15:33.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/1520495874 >> 172.21.15.189:0/1520495874 conn(0x7f5cb4100520 msgr2=0x7f5cb4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:33.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/1520495874 shutdown_connections 2024-09-06T15:15:33.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/1520495874 wait complete. 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 Processor -- start 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- start start 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5cb41a9790 con 0x7f5cb410d640 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5cb41aa990 con 0x7f5cb41111e0 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5cb41abb90 con 0x7f5cb4104ad0 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cb9ea6640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f5cb4104ad0 0x7f5cb41108d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:44254/0 (socket says 172.21.15.189:44254) 2024-09-06T15:15:33.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cb9ea6640 1 -- 172.21.15.189:0/507572184 learned_addr learned my addr 172.21.15.189:0/507572184 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653591531 0 0) 0x7f5cb41abb90 con 0x7f5cb4104ad0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ca0003520 con 0x7f5cb4104ad0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171443035 0 0) 0x7f5cb41a9790 con 0x7f5cb410d640 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb41abb90 con 0x7f5cb410d640 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 166464524 0 0) 0x7f5cb41abb90 con 0x7f5cb410d640 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cb41a9790 con 0x7f5cb410d640 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5cb0001280 con 0x7f5cb410d640 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2623101239 0 0) 0x7f5ca0003520 con 0x7f5cb4104ad0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cb41abb90 con 0x7f5cb4104ad0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5ca40019b0 con 0x7f5cb4104ad0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794624032 0 0) 0x7f5cb41aa990 con 0x7f5cb41111e0 2024-09-06T15:15:33.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ca0003520 con 0x7f5cb41111e0 2024-09-06T15:15:33.724 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3839508375 0 0) 0x7f5cb41a9790 con 0x7f5cb410d640 2024-09-06T15:15:33.724 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 >> v1:172.21.15.189:6790/0 conn(0x7f5cb4104ad0 legacy=0x7f5cb41108d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:33.724 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 >> v1:172.21.15.190:6789/0 conn(0x7f5cb41111e0 legacy=0x7f5cb41a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:33.724 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb41ace30 con 0x7f5cb410d640 2024-09-06T15:15:33.724 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb41a99c0 con 0x7f5cb410d640 2024-09-06T15:15:33.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5cb41a9ff0 con 0x7f5cb410d640 2024-09-06T15:15:33.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5cb0003a60 con 0x7f5cb410d640 2024-09-06T15:15:33.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5cb0004960 con 0x7f5cb410d640 2024-09-06T15:15:33.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.724+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c980050b0 con 0x7f5cb410d640 2024-09-06T15:15:33.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.728+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f5cb00042e0 con 0x7f5cb410d640 2024-09-06T15:15:33.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.728+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f5cb0093950 con 0x7f5cb410d640 2024-09-06T15:15:33.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.732+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f5cb005c8d0 con 0x7f5cb410d640 2024-09-06T15:15:33.936 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c980053a0 con 0x7f5cb410d640 2024-09-06T15:15:33.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5caaffd640 1 -- 172.21.15.189:0/507572184 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f5cb0060a40 con 0x7f5cb410d640 2024-09-06T15:15:33.937 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:33.937 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 >> v1:172.21.15.189:6800/1420554776 conn(0x7f5ca0078400 legacy=0x7f5ca007a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 >> v1:172.21.15.189:6789/0 conn(0x7f5cb410d640 legacy=0x7f5cb41a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 shutdown_connections 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 >> 172.21.15.189:0/507572184 conn(0x7f5cb4100520 msgr2=0x7f5cb41082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 shutdown_connections 2024-09-06T15:15:33.939 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:33.940+0000 7f5cbc10a640 1 -- 172.21.15.189:0/507572184 wait complete. 2024-09-06T15:15:34.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:33 smithi189 bash[22757]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:34.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:33 smithi189 bash[22757]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:34.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:33 smithi189 bash[29727]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:34.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:33 smithi189 bash[29727]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:34.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:33 smithi190 bash[24979]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:34.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:33 smithi190 bash[24979]: cluster 2024-09-06T15:15:33.833423+0000 mgr.y (mgr.14631) 105 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:35.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:34 smithi189 bash[22757]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:35.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:34 smithi189 bash[22757]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:35.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:34 smithi189 bash[29727]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:35.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:34 smithi189 bash[29727]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:35.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:34 smithi190 bash[24979]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:35.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:34 smithi190 bash[24979]: audit 2024-09-06T15:15:33.943753+0000 mon.a (mon.0) 854 : audit [DBG] from='client.? v1:172.21.15.189:0/507572184' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:36.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[22757]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[22757]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[22757]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[22757]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[29727]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[29727]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[29727]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:35 smithi189 bash[29727]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:36.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:35 smithi190 bash[24979]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:35 smithi190 bash[24979]: audit 2024-09-06T15:15:35.326668+0000 mon.c (mon.2) 84 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:36.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:35 smithi190 bash[24979]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:36.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:35 smithi190 bash[24979]: cluster 2024-09-06T15:15:35.834819+0000 mgr.y (mgr.14631) 106 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:37.552 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:15:38.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:37 smithi189 bash[22757]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:38.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:37 smithi189 bash[22757]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:38.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:37 smithi189 bash[29727]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:38.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:37 smithi189 bash[29727]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:38.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:37 smithi190 bash[24979]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:38.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:37 smithi190 bash[24979]: cluster 2024-09-06T15:15:37.835505+0000 mgr.y (mgr.14631) 107 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:39 smithi189 bash[22757]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:39 smithi189 bash[22757]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:39 smithi189 bash[29727]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:39 smithi189 bash[29727]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:39 smithi190 bash[24979]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:40.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:39 smithi190 bash[24979]: cluster 2024-09-06T15:15:39.836146+0000 mgr.y (mgr.14631) 108 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:41.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:40 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:42.167 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[22757]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.167 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[22757]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[22757]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[22757]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[29727]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[29727]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[29727]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:41 smithi189 bash[29727]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.350 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:41 smithi190 bash[24979]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:41 smithi190 bash[24979]: audit 2024-09-06T15:15:40.879255+0000 mgr.y (mgr.14631) 109 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:41 smithi190 bash[24979]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:41 smithi190 bash[24979]: cluster 2024-09-06T15:15:41.837832+0000 mgr.y (mgr.14631) 110 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:42.454 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:42 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:15:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:15:43.531 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.532+0000 7fe284c02640 1 -- 172.21.15.189:0/2038061006 >> v1:172.21.15.189:6790/0 conn(0x7fe280104ad0 legacy=0x7fe280104eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:43.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.532+0000 7fe284c02640 1 -- 172.21.15.189:0/2038061006 shutdown_connections 2024-09-06T15:15:43.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.532+0000 7fe284c02640 1 -- 172.21.15.189:0/2038061006 >> 172.21.15.189:0/2038061006 conn(0x7fe280100520 msgr2=0x7fe280102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:43.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.532+0000 7fe284c02640 1 -- 172.21.15.189:0/2038061006 shutdown_connections 2024-09-06T15:15:43.532 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.532+0000 7fe284c02640 1 -- 172.21.15.189:0/2038061006 wait complete. 2024-09-06T15:15:43.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 Processor -- start 2024-09-06T15:15:43.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- start start 2024-09-06T15:15:43.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2801a9760 con 0x7fe280104ad0 2024-09-06T15:15:43.533 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2801aa960 con 0x7fe28010d640 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2801abb60 con 0x7fe2801111e0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe27e59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe280104ad0 0x7fe2801108a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:59578/0 (socket says 172.21.15.189:59578) 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe27e59c640 1 -- 172.21.15.189:0/1723412102 learned_addr learned my addr 172.21.15.189:0/1723412102 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810884322 0 0) 0x7fe2801a9760 con 0x7fe280104ad0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe268003160 con 0x7fe280104ad0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674331513 0 0) 0x7fe2801abb60 con 0x7fe2801111e0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2801a9760 con 0x7fe2801111e0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1006725888 0 0) 0x7fe2801a9760 con 0x7fe2801111e0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2801abb60 con 0x7fe2801111e0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2448310774 0 0) 0x7fe268003160 con 0x7fe280104ad0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2801a9760 con 0x7fe280104ad0 2024-09-06T15:15:43.534 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe278001cd0 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe274001a90 con 0x7fe280104ad0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757047325 0 0) 0x7fe2801aa960 con 0x7fe28010d640 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe268003160 con 0x7fe28010d640 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2841740949 0 0) 0x7fe2801abb60 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 >> v1:172.21.15.190:6789/0 conn(0x7fe28010d640 legacy=0x7fe2801a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 >> v1:172.21.15.189:6789/0 conn(0x7fe280104ad0 legacy=0x7fe2801108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2801ace00 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2801abd90 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2801ac3c0 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe278003e00 con 0x7fe2801111e0 2024-09-06T15:15:43.535 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe278004c60 con 0x7fe2801111e0 2024-09-06T15:15:43.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2600050b0 con 0x7fe2801111e0 2024-09-06T15:15:43.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.536+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe278003970 con 0x7fe2801111e0 2024-09-06T15:15:43.536 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.540+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe278093d50 con 0x7fe2801111e0 2024-09-06T15:15:43.540 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.544+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe27805ccd0 con 0x7fe2801111e0 2024-09-06T15:15:43.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.744+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe2600053a0 con 0x7fe2801111e0 2024-09-06T15:15:43.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.744+0000 7fe26f7fe640 1 -- 172.21.15.189:0/1723412102 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fe278060e40 con 0x7fe2801111e0 2024-09-06T15:15:43.744 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:43.744 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe2680786c0 legacy=0x7fe26807ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 >> v1:172.21.15.189:6790/0 conn(0x7fe2801111e0 legacy=0x7fe2801a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 shutdown_connections 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 >> 172.21.15.189:0/1723412102 conn(0x7fe280100520 msgr2=0x7fe2801082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 shutdown_connections 2024-09-06T15:15:43.746 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:43.748+0000 7fe284c02640 1 -- 172.21.15.189:0/1723412102 wait complete. 2024-09-06T15:15:44.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:43 smithi189 bash[22757]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:44.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:43 smithi189 bash[22757]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:43 smithi189 bash[29727]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:43 smithi189 bash[29727]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:44.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:43 smithi190 bash[24979]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:44.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:43 smithi190 bash[24979]: audit 2024-09-06T15:15:43.750416+0000 mon.c (mon.2) 85 : audit [DBG] from='client.? v1:172.21.15.189:0/1723412102' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:45.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:44 smithi189 bash[22757]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:45.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:44 smithi189 bash[22757]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:45.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:44 smithi189 bash[29727]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:45.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:44 smithi189 bash[29727]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:45.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:44 smithi190 bash[24979]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:45.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:44 smithi190 bash[24979]: cluster 2024-09-06T15:15:43.838448+0000 mgr.y (mgr.14631) 111 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:46.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:45 smithi189 bash[22757]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:46.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:45 smithi189 bash[22757]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:46.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:45 smithi189 bash[29727]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:46.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:45 smithi189 bash[29727]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:46.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:45 smithi190 bash[24979]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:46.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:45 smithi190 bash[24979]: cluster 2024-09-06T15:15:45.839936+0000 mgr.y (mgr.14631) 112 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:47.377 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:15:48.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:47 smithi189 bash[22757]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:48.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:47 smithi189 bash[22757]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:48.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:47 smithi189 bash[29727]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:48.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:47 smithi189 bash[29727]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:48.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:47 smithi190 bash[24979]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:48.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:47 smithi190 bash[24979]: cluster 2024-09-06T15:15:47.840677+0000 mgr.y (mgr.14631) 113 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:49 smithi189 bash[29727]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:49 smithi189 bash[29727]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:49 smithi189 bash[22757]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:49 smithi189 bash[22757]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:49 smithi190 bash[24979]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:50.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:49 smithi190 bash[24979]: cluster 2024-09-06T15:15:49.841455+0000 mgr.y (mgr.14631) 114 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:51.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:50 smithi189 bash[29727]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:51.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:50 smithi189 bash[29727]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:50 smithi189 bash[22757]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:50 smithi189 bash[22757]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:51.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:15:50 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:15:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:50 smithi190 bash[24979]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:50 smithi190 bash[24979]: audit 2024-09-06T15:15:50.353951+0000 mon.c (mon.2) 86 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:52.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[22757]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[22757]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[22757]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[22757]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[29727]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[29727]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[29727]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:51 smithi189 bash[29727]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.178 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:15:52.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:51 smithi190 bash[24979]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.424 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:51 smithi190 bash[24979]: audit 2024-09-06T15:15:50.886314+0000 mgr.y (mgr.14631) 115 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:15:52.424 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:51 smithi190 bash[24979]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.424 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:51 smithi190 bash[24979]: cluster 2024-09-06T15:15:51.843041+0000 mgr.y (mgr.14631) 116 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:52.599 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:15:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:15:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:15:53.413 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/1950614632 >> v1:172.21.15.189:6790/0 conn(0x7fe97c10efe0 legacy=0x7fe97c111480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/1950614632 shutdown_connections 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/1950614632 >> 172.21.15.189:0/1950614632 conn(0x7fe97c078cc0 msgr2=0x7fe97c0790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/1950614632 shutdown_connections 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/1950614632 wait complete. 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 Processor -- start 2024-09-06T15:15:53.414 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- start start 2024-09-06T15:15:53.416 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe97c1a7610 con 0x7fe97c10efe0 2024-09-06T15:15:53.416 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe97c1a8810 con 0x7fe97c101220 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe97c1a9a10 con 0x7fe97c10b440 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe98107b640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fe97c10b440 0x7fe97c1a2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:46136/0 (socket says 172.21.15.189:46136) 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe98207d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fe97c10efe0 0x7fe97c1a5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:42302/0 (socket says 172.21.15.189:42302) 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe98107b640 1 -- 172.21.15.189:0/384501863 learned_addr learned my addr 172.21.15.189:0/384501863 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746916405 0 0) 0x7fe97c1a7610 con 0x7fe97c10efe0 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe968003520 con 0x7fe97c10efe0 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044588512 0 0) 0x7fe97c1a9a10 con 0x7fe97c10b440 2024-09-06T15:15:53.417 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe97c1a7610 con 0x7fe97c10b440 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3612570318 0 0) 0x7fe968003520 con 0x7fe97c10efe0 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe97c1a9a10 con 0x7fe97c10efe0 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe974001950 con 0x7fe97c10efe0 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371871385 0 0) 0x7fe97c1a8810 con 0x7fe97c101220 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe968003520 con 0x7fe97c101220 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 618343347 0 0) 0x7fe97c1a7610 con 0x7fe97c10b440 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe97c1a8810 con 0x7fe97c10b440 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe96c001a10 con 0x7fe97c10b440 2024-09-06T15:15:53.418 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3396388842 0 0) 0x7fe97c1a9a10 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 >> v1:172.21.15.189:6790/0 conn(0x7fe97c10b440 legacy=0x7fe97c1a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 >> v1:172.21.15.190:6789/0 conn(0x7fe97c101220 legacy=0x7fe97c10ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c1aacb0 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c1a7840 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe97c1a7df0 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe974001da0 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.416+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe974004df0 con 0x7fe97c10efe0 2024-09-06T15:15:53.419 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.420+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9600050b0 con 0x7fe97c10efe0 2024-09-06T15:15:53.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.420+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe974003970 con 0x7fe97c10efe0 2024-09-06T15:15:53.420 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.420+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe974094e80 con 0x7fe97c10efe0 2024-09-06T15:15:53.421 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.424+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe97405de60 con 0x7fe97c10efe0 2024-09-06T15:15:53.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.628+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9600053a0 con 0x7fe97c10efe0 2024-09-06T15:15:53.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.628+0000 7fe972ffd640 1 -- 172.21.15.189:0/384501863 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fe974061fd0 con 0x7fe97c10efe0 2024-09-06T15:15:53.626 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:15:53.627 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:15:53.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe968078420 legacy=0x7fe96807a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:53.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 >> v1:172.21.15.189:6789/0 conn(0x7fe97c10efe0 legacy=0x7fe97c1a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:15:53.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 shutdown_connections 2024-09-06T15:15:53.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 >> 172.21.15.189:0/384501863 conn(0x7fe97c078cc0 msgr2=0x7fe97c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:15:53.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 shutdown_connections 2024-09-06T15:15:53.629 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:15:53.632+0000 7fe983ae0640 1 -- 172.21.15.189:0/384501863 wait complete. 2024-09-06T15:15:54.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:53 smithi189 bash[22757]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:54.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:53 smithi189 bash[22757]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:53 smithi189 bash[29727]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:53 smithi189 bash[29727]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:54.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:53 smithi190 bash[24979]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:54.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:53 smithi190 bash[24979]: audit 2024-09-06T15:15:53.633252+0000 mon.a (mon.0) 855 : audit [DBG] from='client.? v1:172.21.15.189:0/384501863' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:15:55.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:54 smithi189 bash[22757]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:55.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:54 smithi189 bash[22757]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:55.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:54 smithi189 bash[29727]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:55.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:54 smithi189 bash[29727]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:55.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:54 smithi190 bash[24979]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:55.121 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:54 smithi190 bash[24979]: cluster 2024-09-06T15:15:53.843805+0000 mgr.y (mgr.14631) 117 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:56.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:55 smithi189 bash[22757]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:56.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:55 smithi189 bash[22757]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:56.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:55 smithi189 bash[29727]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:56.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:55 smithi189 bash[29727]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:56.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:55 smithi190 bash[24979]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:56.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:55 smithi190 bash[24979]: cluster 2024-09-06T15:15:55.845236+0000 mgr.y (mgr.14631) 118 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:15:57.251 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:15:58.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:57 smithi189 bash[22757]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:58.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:57 smithi189 bash[22757]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:58.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:57 smithi189 bash[29727]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:58.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:57 smithi189 bash[29727]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:58.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:57 smithi190 bash[24979]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:15:58.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:57 smithi190 bash[24979]: cluster 2024-09-06T15:15:57.845939+0000 mgr.y (mgr.14631) 119 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:59 smithi189 bash[22757]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:15:59 smithi189 bash[22757]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:59 smithi189 bash[29727]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:15:59 smithi189 bash[29727]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:59 smithi190 bash[24979]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:00.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:15:59 smithi190 bash[24979]: cluster 2024-09-06T15:15:59.846683+0000 mgr.y (mgr.14631) 120 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:01.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:00 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:02.052 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[22757]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[22757]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[22757]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[22757]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[29727]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[29727]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[29727]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:01 smithi189 bash[29727]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:01 smithi190 bash[24979]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:01 smithi190 bash[24979]: audit 2024-09-06T15:16:00.894233+0000 mgr.y (mgr.14631) 121 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:01 smithi190 bash[24979]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:01 smithi190 bash[24979]: cluster 2024-09-06T15:16:01.848196+0000 mgr.y (mgr.14631) 122 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:02.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:02 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.192+0000 7f2174cfd640 1 -- 172.21.15.189:0/3495836207 >> v1:172.21.15.189:6789/0 conn(0x7f21701111e0 legacy=0x7f21701136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.192+0000 7f2174cfd640 1 -- 172.21.15.189:0/3495836207 shutdown_connections 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.192+0000 7f2174cfd640 1 -- 172.21.15.189:0/3495836207 >> 172.21.15.189:0/3495836207 conn(0x7f21700fe360 msgr2=0x7f2170100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.192+0000 7f2174cfd640 1 -- 172.21.15.189:0/3495836207 shutdown_connections 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.192+0000 7f2174cfd640 1 -- 172.21.15.189:0/3495836207 wait complete. 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 Processor -- start 2024-09-06T15:16:03.192 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- start start 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f21701a97a0 con 0x7f2170075e50 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f21701aa9a0 con 0x7f21701111e0 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f216e59c640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f21700752a0 0x7f217010f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:37070/0 (socket says 172.21.15.189:37070) 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f216e59c640 1 -- 172.21.15.189:0/4273674610 learned_addr learned my addr 172.21.15.189:0/4273674610 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f21701abba0 con 0x7f21700752a0 2024-09-06T15:16:03.194 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163274636 0 0) 0x7f21701a97a0 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2158003160 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409938830 0 0) 0x7f21701abba0 con 0x7f21700752a0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21701a97a0 con 0x7f21700752a0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167319823 0 0) 0x7f21701aa9a0 con 0x7f21701111e0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21701abba0 con 0x7f21701111e0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3183602154 0 0) 0x7f2158003160 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21701aa9a0 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2164001930 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2211784575 0 0) 0x7f21701a97a0 con 0x7f21700752a0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2158003160 con 0x7f21700752a0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2168001410 con 0x7f21700752a0 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2084911531 0 0) 0x7f21701aa9a0 con 0x7f2170075e50 2024-09-06T15:16:03.195 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 >> v1:172.21.15.189:6790/0 conn(0x7f21700752a0 legacy=0x7f217010f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 >> v1:172.21.15.190:6789/0 conn(0x7f21701111e0 legacy=0x7f21701a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21701ace40 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21701abdd0 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f21701ac400 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f2164003a60 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2164004a20 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21500050b0 con 0x7f2170075e50 2024-09-06T15:16:03.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.196+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f21640035f0 con 0x7f2170075e50 2024-09-06T15:16:03.197 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.200+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f2164093c20 con 0x7f2170075e50 2024-09-06T15:16:03.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.200+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f216405cba0 con 0x7f2170075e50 2024-09-06T15:16:03.396 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.396+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21500053a0 con 0x7f2170075e50 2024-09-06T15:16:03.396 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f215f7fe640 1 -- 172.21.15.189:0/4273674610 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f2164060d10 con 0x7f2170075e50 2024-09-06T15:16:03.396 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:03.396 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 >> v1:172.21.15.189:6800/1420554776 conn(0x7f2158078230 legacy=0x7f215807a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 >> v1:172.21.15.189:6789/0 conn(0x7f2170075e50 legacy=0x7f21701a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 shutdown_connections 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 >> 172.21.15.189:0/4273674610 conn(0x7f21700fe360 msgr2=0x7f2170100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 shutdown_connections 2024-09-06T15:16:03.398 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:03.400+0000 7f2174cfd640 1 -- 172.21.15.189:0/4273674610 wait complete. 2024-09-06T15:16:03.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:03 smithi189 bash[22757]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:03.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:03 smithi189 bash[22757]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:03.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:03 smithi189 bash[29727]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:03.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:03 smithi189 bash[29727]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:03.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:03 smithi190 bash[24979]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:03.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:03 smithi190 bash[24979]: audit 2024-09-06T15:16:03.402645+0000 mon.a (mon.0) 856 : audit [DBG] from='client.? v1:172.21.15.189:0/4273674610' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:04.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:04 smithi189 bash[22757]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:04.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:04 smithi189 bash[22757]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:04.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:04 smithi189 bash[29727]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:04.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:04 smithi189 bash[29727]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:04.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:04 smithi190 bash[24979]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:04.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:04 smithi190 bash[24979]: cluster 2024-09-06T15:16:03.848946+0000 mgr.y (mgr.14631) 123 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:05.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:05 smithi189 bash[22757]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:05.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:05 smithi189 bash[22757]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:05.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:05 smithi189 bash[29727]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:05.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:05 smithi189 bash[29727]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:05.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:05 smithi190 bash[24979]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:05.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:05 smithi190 bash[24979]: audit 2024-09-06T15:16:05.381990+0000 mon.c (mon.2) 87 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:06.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:06 smithi189 bash[22757]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:06.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:06 smithi189 bash[22757]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:06.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:06 smithi189 bash[29727]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:06.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:06 smithi189 bash[29727]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:06.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:06 smithi190 bash[24979]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:06.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:06 smithi190 bash[24979]: cluster 2024-09-06T15:16:05.850391+0000 mgr.y (mgr.14631) 124 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:07.069 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:08.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:07 smithi189 bash[22757]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:08.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:07 smithi189 bash[22757]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:08.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:07 smithi189 bash[29727]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:08.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:07 smithi189 bash[29727]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:08.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:07 smithi190 bash[24979]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:08.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:07 smithi190 bash[24979]: cluster 2024-09-06T15:16:07.851123+0000 mgr.y (mgr.14631) 125 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:09.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:08 smithi189 bash[22757]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:09.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:08 smithi189 bash[22757]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:09.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:08 smithi189 bash[29727]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:09.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:08 smithi189 bash[29727]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:09.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:08 smithi190 bash[24979]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:09.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:08 smithi190 bash[24979]: audit 2024-09-06T15:16:08.311983+0000 mon.c (mon.2) 88 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:10.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:09 smithi189 bash[22757]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:10.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:09 smithi189 bash[22757]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:10.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:09 smithi189 bash[29727]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:10.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:09 smithi189 bash[29727]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:10.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:09 smithi190 bash[24979]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:10.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:09 smithi190 bash[24979]: cluster 2024-09-06T15:16:09.851587+0000 mgr.y (mgr.14631) 126 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:11.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:10 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:11.873 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:12.167 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[22757]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.167 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[22757]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[22757]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[22757]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[29727]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[29727]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[29727]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:11 smithi189 bash[29727]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:11 smithi190 bash[24979]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:11 smithi190 bash[24979]: audit 2024-09-06T15:16:10.902329+0000 mgr.y (mgr.14631) 127 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:11 smithi190 bash[24979]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:11 smithi190 bash[24979]: cluster 2024-09-06T15:16:11.853042+0000 mgr.y (mgr.14631) 128 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:12.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:13.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.016+0000 7f2e91f9e640 1 -- 172.21.15.189:0/1320646198 >> v1:172.21.15.189:6789/0 conn(0x7f2e8c10ded0 legacy=0x7f2e8c110390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:13.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.016+0000 7f2e91f9e640 1 -- 172.21.15.189:0/1320646198 shutdown_connections 2024-09-06T15:16:13.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.016+0000 7f2e91f9e640 1 -- 172.21.15.189:0/1320646198 >> 172.21.15.189:0/1320646198 conn(0x7f2e8c0fd210 msgr2=0x7f2e8c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.016+0000 7f2e91f9e640 1 -- 172.21.15.189:0/1320646198 shutdown_connections 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.016+0000 7f2e91f9e640 1 -- 172.21.15.189:0/1320646198 wait complete. 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 Processor -- start 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- start start 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2e8c1a75c0 con 0x7f2e8c10a330 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2e8c1a87c0 con 0x7f2e8c10ded0 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2e8c1a99c0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e8b7fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f2e8c1017c0 0x7f2e8c10d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:52510/0 (socket says 172.21.15.189:52510) 2024-09-06T15:16:13.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e8b7fe640 1 -- 172.21.15.189:0/3460360269 learned_addr learned my addr 172.21.15.189:0/3460360269 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:13.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204503777 0 0) 0x7f2e8c1a99c0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e74001fe0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2392868813 0 0) 0x7f2e8c1a75c0 con 0x7f2e8c10a330 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c1a99c0 con 0x7f2e8c10a330 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074377193 0 0) 0x7f2e8c1a87c0 con 0x7f2e8c10ded0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c1a75c0 con 0x7f2e8c10ded0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3886525961 0 0) 0x7f2e74001fe0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e8c1a87c0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2e7c0013b0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 782669415 0 0) 0x7f2e8c1a99c0 con 0x7f2e8c10a330 2024-09-06T15:16:13.019 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e74001fe0 con 0x7f2e8c10a330 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2e800017e0 con 0x7f2e8c10a330 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3741368311 0 0) 0x7f2e8c1a87c0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 >> v1:172.21.15.190:6789/0 conn(0x7f2e8c10ded0 legacy=0x7f2e8c1a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 >> v1:172.21.15.189:6789/0 conn(0x7f2e8c10a330 legacy=0x7f2e8c1a2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c1aac60 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c1a77f0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1a7e20 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f2e7c001670 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2e7c005c30 con 0x7f2e8c1017c0 2024-09-06T15:16:13.020 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e78005080 con 0x7f2e8c1017c0 2024-09-06T15:16:13.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.020+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f2e7c003f00 con 0x7f2e8c1017c0 2024-09-06T15:16:13.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.024+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f2e7c094c40 con 0x7f2e8c1017c0 2024-09-06T15:16:13.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.032+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f2e7c05dbc0 con 0x7f2e8c1017c0 2024-09-06T15:16:13.249 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.252+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e78005370 con 0x7f2e8c1017c0 2024-09-06T15:16:13.250 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.252+0000 7f2e88ff9640 1 -- 172.21.15.189:0/3460360269 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f2e7c061d30 con 0x7f2e8c1017c0 2024-09-06T15:16:13.250 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:13.250 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:13.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 >> v1:172.21.15.189:6800/1420554776 conn(0x7f2e740783c0 legacy=0x7f2e7407a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:13.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 >> v1:172.21.15.189:6790/0 conn(0x7f2e8c1017c0 legacy=0x7f2e8c10d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:13.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 shutdown_connections 2024-09-06T15:16:13.253 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 >> 172.21.15.189:0/3460360269 conn(0x7f2e8c0fd210 msgr2=0x7f2e8c105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:13.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 shutdown_connections 2024-09-06T15:16:13.254 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:13.256+0000 7f2e91f9e640 1 -- 172.21.15.189:0/3460360269 wait complete. 2024-09-06T15:16:13.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:13 smithi189 bash[22757]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:13.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:13 smithi189 bash[22757]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:13.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:13 smithi189 bash[29727]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:13.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:13 smithi189 bash[29727]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:13 smithi190 bash[24979]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:13 smithi190 bash[24979]: audit 2024-09-06T15:16:13.256495+0000 mon.c (mon.2) 89 : audit [DBG] from='client.? v1:172.21.15.189:0/3460360269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:14.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[22757]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:14 smithi189 bash[29727]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:13.514771+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:13.525538+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: cluster 2024-09-06T15:16:13.853718+0000 mgr.y (mgr.14631) 129 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:14.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:14.316857+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:14.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:14 smithi190 bash[24979]: audit 2024-09-06T15:16:14.331106+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[29727]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:15 smithi189 bash[22757]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:14.995962+0000 mon.c (mon.2) 90 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:15.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:14.997336+0000 mon.c (mon.2) 91 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:15.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:15.871 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:15 smithi190 bash[24979]: audit 2024-09-06T15:16:15.006597+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:16:16.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:16 smithi189 bash[22757]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:16.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:16 smithi189 bash[22757]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:16.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:16 smithi189 bash[29727]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:16.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:16 smithi189 bash[29727]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:16.861 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:16.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:16 smithi190 bash[24979]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:16.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:16 smithi190 bash[24979]: cluster 2024-09-06T15:16:15.855366+0000 mgr.y (mgr.14631) 130 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:18.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:17 smithi189 bash[22757]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:18.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:17 smithi189 bash[22757]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:17 smithi189 bash[29727]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:18.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:17 smithi189 bash[29727]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:18.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:17 smithi190 bash[24979]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:18.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:17 smithi190 bash[24979]: cluster 2024-09-06T15:16:17.856013+0000 mgr.y (mgr.14631) 131 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:19 smithi189 bash[22757]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:19 smithi189 bash[22757]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:19 smithi189 bash[29727]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:19 smithi189 bash[29727]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:19 smithi190 bash[24979]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:20.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:19 smithi190 bash[24979]: cluster 2024-09-06T15:16:19.856709+0000 mgr.y (mgr.14631) 132 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:21.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:20 smithi189 bash[22757]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:20 smithi189 bash[22757]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:20 smithi189 bash[29727]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:20 smithi189 bash[29727]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:20 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:21.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:20 smithi190 bash[24979]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:20 smithi190 bash[24979]: audit 2024-09-06T15:16:20.409851+0000 mon.c (mon.2) 92 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:21.668 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[22757]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[22757]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[22757]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[22757]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[29727]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[29727]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[29727]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:21 smithi189 bash[29727]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:21 smithi190 bash[24979]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:21 smithi190 bash[24979]: audit 2024-09-06T15:16:20.913618+0000 mgr.y (mgr.14631) 133 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:22.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:21 smithi190 bash[24979]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:21 smithi190 bash[24979]: cluster 2024-09-06T15:16:21.858229+0000 mgr.y (mgr.14631) 134 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:22.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:22.919 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.919+0000 7f61b933b640 1 -- 172.21.15.189:0/1772589671 >> v1:172.21.15.189:6790/0 conn(0x7f61b41111d0 legacy=0x7f61b4113690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:22.920 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.919+0000 7f61b933b640 1 -- 172.21.15.189:0/1772589671 shutdown_connections 2024-09-06T15:16:22.920 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.919+0000 7f61b933b640 1 -- 172.21.15.189:0/1772589671 >> 172.21.15.189:0/1772589671 conn(0x7f61b40fe330 msgr2=0x7f61b4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:22.920 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.919+0000 7f61b933b640 1 -- 172.21.15.189:0/1772589671 shutdown_connections 2024-09-06T15:16:22.920 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.919+0000 7f61b933b640 1 -- 172.21.15.189:0/1772589671 wait complete. 2024-09-06T15:16:22.921 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 Processor -- start 2024-09-06T15:16:22.921 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- start start 2024-09-06T15:16:22.921 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61b41a9760 con 0x7f61b41111d0 2024-09-06T15:16:22.921 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61b41aa960 con 0x7f61b40752a0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f61b41abb60 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b27fc640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f61b4075e50 0x7f61b41a4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:58448/0 (socket says 172.21.15.189:58448) 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b27fc640 1 -- 172.21.15.189:0/303789727 learned_addr learned my addr 172.21.15.189:0/303789727 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307988151 0 0) 0x7f61b41abb60 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a0003160 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703457254 0 0) 0x7f61b41a9760 con 0x7f61b41111d0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b41abb60 con 0x7f61b41111d0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3201124341 0 0) 0x7f61a0003160 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61b41a9760 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f61a40019e0 con 0x7f61b4075e50 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780831938 0 0) 0x7f61b41aa960 con 0x7f61b40752a0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a0003160 con 0x7f61b40752a0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702489023 0 0) 0x7f61b41abb60 con 0x7f61b41111d0 2024-09-06T15:16:22.922 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61b41aa960 con 0x7f61b41111d0 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f61ac001790 con 0x7f61b41111d0 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2296786589 0 0) 0x7f61b41a9760 con 0x7f61b4075e50 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 >> v1:172.21.15.190:6789/0 conn(0x7f61b40752a0 legacy=0x7f61b410f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 >> v1:172.21.15.189:6789/0 conn(0x7f61b41111d0 legacy=0x7f61b41a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b41ace00 con 0x7f61b4075e50 2024-09-06T15:16:22.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61b41a9990 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f61b41a9f40 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f61a4003a60 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f61a4005c00 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61940050b0 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.923+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f61a401e3b0 con 0x7f61b4075e50 2024-09-06T15:16:22.924 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.927+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f61a4094c90 con 0x7f61b4075e50 2024-09-06T15:16:22.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:22.931+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f61a405dc10 con 0x7f61b4075e50 2024-09-06T15:16:23.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.127+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61940053a0 con 0x7f61b4075e50 2024-09-06T15:16:23.128 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61abfff640 1 -- 172.21.15.189:0/303789727 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f61a4061d80 con 0x7f61b4075e50 2024-09-06T15:16:23.129 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:23.129 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:23.130 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 >> v1:172.21.15.189:6800/1420554776 conn(0x7f61a0078450 legacy=0x7f61a007a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:23.130 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 >> v1:172.21.15.189:6790/0 conn(0x7f61b4075e50 legacy=0x7f61b41a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:23.130 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 shutdown_connections 2024-09-06T15:16:23.131 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 >> 172.21.15.189:0/303789727 conn(0x7f61b40fe330 msgr2=0x7f61b4100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:23.131 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 shutdown_connections 2024-09-06T15:16:23.131 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:23.131+0000 7f61b933b640 1 -- 172.21.15.189:0/303789727 wait complete. 2024-09-06T15:16:23.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:23 smithi189 bash[22757]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:23.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:23 smithi189 bash[22757]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:23.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:23 smithi189 bash[29727]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:23.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:23 smithi189 bash[29727]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:23 smithi190 bash[24979]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:23 smithi190 bash[24979]: audit 2024-09-06T15:16:23.135023+0000 mon.c (mon.2) 93 : audit [DBG] from='client.? v1:172.21.15.189:0/303789727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:24.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:24 smithi189 bash[22757]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:24.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:24 smithi189 bash[22757]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:24.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:24 smithi189 bash[29727]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:24.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:24 smithi189 bash[29727]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:24.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:24 smithi190 bash[24979]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:24.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:24 smithi190 bash[24979]: cluster 2024-09-06T15:16:23.858970+0000 mgr.y (mgr.14631) 135 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:26.767 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:27.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:26 smithi189 bash[22757]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:27.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:26 smithi189 bash[22757]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:27.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:26 smithi189 bash[29727]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:27.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:26 smithi189 bash[29727]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:27.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:26 smithi190 bash[24979]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:27.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:26 smithi190 bash[24979]: cluster 2024-09-06T15:16:25.860392+0000 mgr.y (mgr.14631) 136 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:29.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:28 smithi189 bash[22757]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:29.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:28 smithi189 bash[22757]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:29.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:28 smithi189 bash[29727]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:29.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:28 smithi189 bash[29727]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:29.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:28 smithi190 bash[24979]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:29.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:28 smithi190 bash[24979]: cluster 2024-09-06T15:16:27.861083+0000 mgr.y (mgr.14631) 137 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:30 smithi189 bash[22757]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:30 smithi189 bash[22757]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:30 smithi189 bash[29727]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:30 smithi189 bash[29727]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:30 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:31.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:30 smithi190 bash[24979]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:30 smithi190 bash[24979]: cluster 2024-09-06T15:16:29.861781+0000 mgr.y (mgr.14631) 138 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:31.573 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:32.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:32 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:32.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:31 smithi189 bash[22757]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:31 smithi189 bash[22757]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:31 smithi189 bash[29727]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:31 smithi189 bash[29727]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:31 smithi190 bash[24979]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:31 smithi190 bash[24979]: audit 2024-09-06T15:16:30.922271+0000 mgr.y (mgr.14631) 139 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:32.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.823+0000 7f5e2261a640 1 -- 172.21.15.189:0/2617185433 >> v1:172.21.15.189:6790/0 conn(0x7f5e1c1111e0 legacy=0x7f5e1c1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:32.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.823+0000 7f5e2261a640 1 -- 172.21.15.189:0/2617185433 shutdown_connections 2024-09-06T15:16:32.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.823+0000 7f5e2261a640 1 -- 172.21.15.189:0/2617185433 >> 172.21.15.189:0/2617185433 conn(0x7f5e1c100520 msgr2=0x7f5e1c102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:32.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.823+0000 7f5e2261a640 1 -- 172.21.15.189:0/2617185433 shutdown_connections 2024-09-06T15:16:32.823 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.823+0000 7f5e2261a640 1 -- 172.21.15.189:0/2617185433 wait complete. 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 Processor -- start 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- start start 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e1c1a9790 con 0x7f5e1c104ad0 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e1c1aa990 con 0x7f5e1c1111e0 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f5e1c1abb90 con 0x7f5e1c10d640 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e1bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5e1c104ad0 0x7f5e1c110900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:44932/0 (socket says 172.21.15.189:44932) 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e1bfff640 1 -- 172.21.15.189:0/2173323711 learned_addr learned my addr 172.21.15.189:0/2173323711 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450144132 0 0) 0x7f5e1c1a9790 con 0x7f5e1c104ad0 2024-09-06T15:16:32.825 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e04003520 con 0x7f5e1c104ad0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740506178 0 0) 0x7f5e1c1abb90 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e1c1a9790 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 267401337 0 0) 0x7f5e1c1a9790 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e1c1abb90 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 452720676 0 0) 0x7f5e04003520 con 0x7f5e1c104ad0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e1c1a9790 con 0x7f5e1c104ad0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e0c0013b0 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243753708 0 0) 0x7f5e1c1aa990 con 0x7f5e1c1111e0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e04003520 con 0x7f5e1c1111e0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e100019f0 con 0x7f5e1c104ad0 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3853031762 0 0) 0x7f5e1c1abb90 con 0x7f5e1c10d640 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 >> v1:172.21.15.190:6789/0 conn(0x7f5e1c1111e0 legacy=0x7f5e1c1a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:32.826 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 >> v1:172.21.15.189:6789/0 conn(0x7f5e1c104ad0 legacy=0x7f5e1c110900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:32.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1c1ace30 con 0x7f5e1c10d640 2024-09-06T15:16:32.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1c1a99c0 con 0x7f5e1c10d640 2024-09-06T15:16:32.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e1c1a9ff0 con 0x7f5e1c10d640 2024-09-06T15:16:32.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f5e0c003a60 con 0x7f5e1c10d640 2024-09-06T15:16:32.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f5e0c004990 con 0x7f5e1c10d640 2024-09-06T15:16:32.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e080050b0 con 0x7f5e1c10d640 2024-09-06T15:16:32.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f5e0c0035f0 con 0x7f5e1c10d640 2024-09-06T15:16:32.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.827+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f5e0c093a20 con 0x7f5e1c10d640 2024-09-06T15:16:32.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:32.831+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f5e0c05c9e0 con 0x7f5e1c10d640 2024-09-06T15:16:33.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.031+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5e080053a0 con 0x7f5e1c10d640 2024-09-06T15:16:33.032 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e197fa640 1 -- 172.21.15.189:0/2173323711 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f5e0c060b50 con 0x7f5e1c10d640 2024-09-06T15:16:33.032 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:33.032 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 >> v1:172.21.15.189:6800/1420554776 conn(0x7f5e04078490 legacy=0x7f5e0407a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 >> v1:172.21.15.189:6790/0 conn(0x7f5e1c10d640 legacy=0x7f5e1c1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 shutdown_connections 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 >> 172.21.15.189:0/2173323711 conn(0x7f5e1c100520 msgr2=0x7f5e1c1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 shutdown_connections 2024-09-06T15:16:33.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:33.035+0000 7f5e2261a640 1 -- 172.21.15.189:0/2173323711 wait complete. 2024-09-06T15:16:33.239 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:32 smithi189 bash[22757]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:33.240 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:32 smithi189 bash[22757]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:33.240 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:32 smithi189 bash[29727]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:33.240 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:32 smithi189 bash[29727]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:33.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:32 smithi190 bash[24979]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:33.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:32 smithi190 bash[24979]: cluster 2024-09-06T15:16:31.863261+0000 mgr.y (mgr.14631) 140 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:33 smithi189 bash[22757]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:33 smithi189 bash[22757]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:34.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:33 smithi189 bash[29727]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:34.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:33 smithi189 bash[29727]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:34.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:33 smithi190 bash[24979]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:34.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:33 smithi190 bash[24979]: audit 2024-09-06T15:16:33.038732+0000 mon.c (mon.2) 94 : audit [DBG] from='client.? v1:172.21.15.189:0/2173323711' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:35.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:34 smithi189 bash[22757]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:35.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:34 smithi189 bash[22757]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:35.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:34 smithi189 bash[29727]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:35.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:34 smithi189 bash[29727]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:35.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:34 smithi190 bash[24979]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:35.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:34 smithi190 bash[24979]: cluster 2024-09-06T15:16:33.863988+0000 mgr.y (mgr.14631) 141 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:36.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:35 smithi189 bash[22757]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:35 smithi189 bash[22757]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:35 smithi189 bash[29727]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:35 smithi189 bash[29727]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:35 smithi190 bash[24979]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:35 smithi190 bash[24979]: audit 2024-09-06T15:16:35.437563+0000 mon.c (mon.2) 95 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:36.710 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:37.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:36 smithi189 bash[22757]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:37.101 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:36 smithi189 bash[22757]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:36 smithi189 bash[29727]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:37.101 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:36 smithi189 bash[29727]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:37.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:36 smithi190 bash[24979]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:37.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:36 smithi190 bash[24979]: cluster 2024-09-06T15:16:35.865417+0000 mgr.y (mgr.14631) 142 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:38.620 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:16:38 smithi190 bash[51708]: logger=infra.usagestats t=2024-09-06T15:16:38.187482738Z level=info msg="Usage stats are ready to report" 2024-09-06T15:16:39.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:38 smithi189 bash[22757]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:39.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:38 smithi189 bash[22757]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:39.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:38 smithi189 bash[29727]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:39.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:38 smithi189 bash[29727]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:39.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:38 smithi190 bash[24979]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:39.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:38 smithi190 bash[24979]: cluster 2024-09-06T15:16:37.866098+0000 mgr.y (mgr.14631) 143 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:40 smithi189 bash[29727]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:40 smithi189 bash[29727]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:40 smithi189 bash[22757]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:40 smithi189 bash[22757]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:40 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:41.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:40 smithi190 bash[24979]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:40 smithi190 bash[24979]: cluster 2024-09-06T15:16:39.866826+0000 mgr.y (mgr.14631) 144 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:41.507 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:42.347 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:42 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:42.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:41 smithi189 bash[22757]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:41 smithi189 bash[22757]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:41 smithi189 bash[29727]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:41 smithi189 bash[29727]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:41 smithi190 bash[24979]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:41 smithi190 bash[24979]: audit 2024-09-06T15:16:40.933550+0000 mgr.y (mgr.14631) 145 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:42.878 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2489972659 >> v1:172.21.15.189:6790/0 conn(0x7fb6bc10b440 legacy=0x7fb6bc10d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2489972659 shutdown_connections 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2489972659 >> 172.21.15.189:0/2489972659 conn(0x7fb6bc0fe360 msgr2=0x7fb6bc100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2489972659 shutdown_connections 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2489972659 wait complete. 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 Processor -- start 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- start start 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6bc1a97b0 con 0x7fb6bc1028d0 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6bc1aa9b0 con 0x7fb6bc10b440 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fb6bc1abbb0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6bad9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fb6bc10efe0 0x7fb6bc1a7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:56792/0 (socket says 172.21.15.189:56792) 2024-09-06T15:16:42.879 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6bad9d640 1 -- 172.21.15.189:0/2562495046 learned_addr learned my addr 172.21.15.189:0/2562495046 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ba59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fb6bc1028d0 0x7fb6bc076a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39822/0 (socket says 172.21.15.189:39822) 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035945053 0 0) 0x7fb6bc1a97b0 con 0x7fb6bc1028d0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a4003520 con 0x7fb6bc1028d0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808260524 0 0) 0x7fb6bc1abbb0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6bc1a97b0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 79395332 0 0) 0x7fb6bc1a97b0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6bc1abbb0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 635650361 0 0) 0x7fb6a4003520 con 0x7fb6bc1028d0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6bc1a97b0 con 0x7fb6bc1028d0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb6b4001730 con 0x7fb6bc10efe0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb6ac001970 con 0x7fb6bc1028d0 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333409867 0 0) 0x7fb6bc1aa9b0 con 0x7fb6bc10b440 2024-09-06T15:16:42.880 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a4003520 con 0x7fb6bc10b440 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1538219764 0 0) 0x7fb6bc1abbb0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 >> v1:172.21.15.190:6789/0 conn(0x7fb6bc10b440 legacy=0x7fb6bc1a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 >> v1:172.21.15.189:6789/0 conn(0x7fb6bc1028d0 legacy=0x7fb6bc076a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc1ace50 con 0x7fb6bc10efe0 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc1a99e0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.881 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6bc1a9f90 con 0x7fb6bc10efe0 2024-09-06T15:16:42.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fb6b4002050 con 0x7fb6bc10efe0 2024-09-06T15:16:42.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.879+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fb6b4005eb0 con 0x7fb6bc10efe0 2024-09-06T15:16:42.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.883+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc103b80 con 0x7fb6bc10efe0 2024-09-06T15:16:42.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.883+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fb6b4006130 con 0x7fb6bc10efe0 2024-09-06T15:16:42.882 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.883+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fb6b4095180 con 0x7fb6bc10efe0 2024-09-06T15:16:42.884 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:42.887+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fb6b405ee40 con 0x7fb6bc10efe0 2024-09-06T15:16:43.085 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb6bc114d90 con 0x7fb6bc10efe0 2024-09-06T15:16:43.085 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6ab7fe640 1 -- 172.21.15.189:0/2562495046 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fb6b4062fb0 con 0x7fb6bc10efe0 2024-09-06T15:16:43.086 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:43.086 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 >> v1:172.21.15.189:6800/1420554776 conn(0x7fb6a4078470 legacy=0x7fb6a407a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 >> v1:172.21.15.189:6790/0 conn(0x7fb6bc10efe0 legacy=0x7fb6bc1a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 shutdown_connections 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 >> 172.21.15.189:0/2562495046 conn(0x7fb6bc0fe360 msgr2=0x7fb6bc1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 shutdown_connections 2024-09-06T15:16:43.089 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:43.087+0000 7fb6c08e1640 1 -- 172.21.15.189:0/2562495046 wait complete. 2024-09-06T15:16:43.287 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:42 smithi189 bash[29727]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:43.287 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:42 smithi189 bash[29727]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:43.288 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:42 smithi189 bash[22757]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:43.288 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:42 smithi189 bash[22757]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:43.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:42 smithi190 bash[24979]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:43.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:42 smithi190 bash[24979]: cluster 2024-09-06T15:16:41.868257+0000 mgr.y (mgr.14631) 146 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:44.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:43 smithi189 bash[22757]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:44.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:43 smithi189 bash[22757]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:43 smithi189 bash[29727]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:43 smithi189 bash[29727]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:44.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:43 smithi190 bash[24979]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:44.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:43 smithi190 bash[24979]: audit 2024-09-06T15:16:43.091569+0000 mon.c (mon.2) 96 : audit [DBG] from='client.? v1:172.21.15.189:0/2562495046' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:45.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:44 smithi189 bash[22757]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:45.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:44 smithi189 bash[22757]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:45.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:44 smithi189 bash[29727]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:45.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:44 smithi189 bash[29727]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:45.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:44 smithi190 bash[24979]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:45.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:44 smithi190 bash[24979]: cluster 2024-09-06T15:16:43.868956+0000 mgr.y (mgr.14631) 147 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:46.754 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:47.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:46 smithi189 bash[22757]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:47.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:46 smithi189 bash[22757]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:47.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:46 smithi189 bash[29727]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:47.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:46 smithi189 bash[29727]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:47.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:46 smithi190 bash[24979]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:47.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:46 smithi190 bash[24979]: cluster 2024-09-06T15:16:45.870352+0000 mgr.y (mgr.14631) 148 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:49.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:48 smithi189 bash[22757]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:49.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:48 smithi189 bash[22757]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:49.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:48 smithi189 bash[29727]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:49.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:48 smithi189 bash[29727]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:49.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:49 smithi190 bash[24979]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:49.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:49 smithi190 bash[24979]: cluster 2024-09-06T15:16:47.871119+0000 mgr.y (mgr.14631) 149 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[22757]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[22757]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[22757]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[22757]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[29727]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[29727]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[29727]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:51 smithi189 bash[29727]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:16:50 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:16:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:51 smithi190 bash[24979]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:51 smithi190 bash[24979]: cluster 2024-09-06T15:16:49.871931+0000 mgr.y (mgr.14631) 150 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:51 smithi190 bash[24979]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:51 smithi190 bash[24979]: audit 2024-09-06T15:16:50.465797+0000 mon.c (mon.2) 97 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:51.563 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:16:52.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:16:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:16:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:16:52.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:52 smithi189 bash[22757]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:52 smithi189 bash[22757]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:52 smithi189 bash[29727]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:52 smithi189 bash[29727]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:52 smithi190 bash[24979]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:52 smithi190 bash[24979]: audit 2024-09-06T15:16:50.944798+0000 mgr.y (mgr.14631) 151 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:16:52.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/3324225707 >> v1:172.21.15.189:6789/0 conn(0x7fdf4010a340 legacy=0x7fdf4010c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:52.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/3324225707 shutdown_connections 2024-09-06T15:16:52.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/3324225707 >> 172.21.15.189:0/3324225707 conn(0x7fdf40077ca0 msgr2=0x7fdf400780b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:52.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/3324225707 shutdown_connections 2024-09-06T15:16:52.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/3324225707 wait complete. 2024-09-06T15:16:52.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 Processor -- start 2024-09-06T15:16:52.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- start start 2024-09-06T15:16:52.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fdf401a7420 con 0x7fdf4010a340 2024-09-06T15:16:52.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fdf401a8620 con 0x7fdf40107410 2024-09-06T15:16:52.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fdf401a9820 con 0x7fdf4010dee0 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3ffff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fdf4010dee0 0x7fdf401a5b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:39598/0 (socket says 172.21.15.189:39598) 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3ffff640 1 -- 172.21.15.189:0/1832050927 learned_addr learned my addr 172.21.15.189:0/1832050927 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3effd640 1 --1- 172.21.15.189:0/1832050927 >> v1:172.21.15.189:6789/0 conn(0x7fdf4010a340 0x7fdf401a2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38256/0 (socket says 172.21.15.189:38256) 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560610734 0 0) 0x7fdf401a9820 con 0x7fdf4010dee0 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf28003520 con 0x7fdf4010dee0 2024-09-06T15:16:52.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891054579 0 0) 0x7fdf401a7420 con 0x7fdf4010a340 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf401a9820 con 0x7fdf4010a340 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4291944068 0 0) 0x7fdf28003520 con 0x7fdf4010dee0 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf401a7420 con 0x7fdf4010dee0 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fdf38001c70 con 0x7fdf4010dee0 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312742625 0 0) 0x7fdf401a8620 con 0x7fdf40107410 2024-09-06T15:16:52.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf28003520 con 0x7fdf40107410 2024-09-06T15:16:52.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422292299 0 0) 0x7fdf401a9820 con 0x7fdf4010a340 2024-09-06T15:16:52.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf401a8620 con 0x7fdf4010a340 2024-09-06T15:16:52.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fdf34001650 con 0x7fdf4010a340 2024-09-06T15:16:52.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3129756686 0 0) 0x7fdf401a7420 con 0x7fdf4010dee0 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 >> v1:172.21.15.190:6789/0 conn(0x7fdf40107410 legacy=0x7fdf40106860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 >> v1:172.21.15.189:6789/0 conn(0x7fdf4010a340 legacy=0x7fdf401a2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf401aaac0 con 0x7fdf4010dee0 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdf401a9a50 con 0x7fdf4010dee0 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdf401aa080 con 0x7fdf4010dee0 2024-09-06T15:16:52.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fdf38003e00 con 0x7fdf4010dee0 2024-09-06T15:16:52.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fdf38005f10 con 0x7fdf4010dee0 2024-09-06T15:16:52.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.827+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c0050b0 con 0x7fdf4010dee0 2024-09-06T15:16:52.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.831+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fdf38003990 con 0x7fdf4010dee0 2024-09-06T15:16:52.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.831+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fdf38095090 con 0x7fdf4010dee0 2024-09-06T15:16:52.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:52.835+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fdf3805e010 con 0x7fdf4010dee0 2024-09-06T15:16:53.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.031+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdf2c0053a0 con 0x7fdf4010dee0 2024-09-06T15:16:53.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.031+0000 7fdf3cff9640 1 -- 172.21.15.189:0/1832050927 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fdf38062180 con 0x7fdf4010dee0 2024-09-06T15:16:53.032 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:16:53.032 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 >> v1:172.21.15.189:6800/1420554776 conn(0x7fdf28078400 legacy=0x7fdf2807a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 >> v1:172.21.15.189:6790/0 conn(0x7fdf4010dee0 legacy=0x7fdf401a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 shutdown_connections 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 >> 172.21.15.189:0/1832050927 conn(0x7fdf40077ca0 msgr2=0x7fdf40108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 shutdown_connections 2024-09-06T15:16:53.034 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:16:53.035+0000 7fdf45da9640 1 -- 172.21.15.189:0/1832050927 wait complete. 2024-09-06T15:16:53.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:53 smithi189 bash[22757]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:53.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:53 smithi189 bash[22757]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:53.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:53 smithi189 bash[29727]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:53.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:53 smithi189 bash[29727]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:53.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:53 smithi190 bash[24979]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:53.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:53 smithi190 bash[24979]: cluster 2024-09-06T15:16:51.873433+0000 mgr.y (mgr.14631) 152 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:54.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:54 smithi189 bash[22757]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:54.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:54 smithi189 bash[22757]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:54.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:54 smithi189 bash[29727]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:54.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:54 smithi189 bash[29727]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:54.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:54 smithi190 bash[24979]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:54.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:54 smithi190 bash[24979]: audit 2024-09-06T15:16:53.038212+0000 mon.c (mon.2) 98 : audit [DBG] from='client.? v1:172.21.15.189:0/1832050927' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:16:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:55 smithi189 bash[22757]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:55.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:55 smithi189 bash[22757]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:55.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:55 smithi189 bash[29727]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:55.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:55 smithi189 bash[29727]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:55.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:55 smithi190 bash[24979]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:55.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:55 smithi190 bash[24979]: cluster 2024-09-06T15:16:53.874171+0000 mgr.y (mgr.14631) 153 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:56.712 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:16:57.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:57 smithi189 bash[22757]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:57.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:57 smithi189 bash[22757]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:57 smithi189 bash[29727]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:57.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:57 smithi189 bash[29727]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:57.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:57 smithi190 bash[24979]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:57.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:57 smithi190 bash[24979]: cluster 2024-09-06T15:16:55.875645+0000 mgr.y (mgr.14631) 154 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:16:59.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:59 smithi189 bash[22757]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:59.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:16:59 smithi189 bash[22757]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:59.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:59 smithi189 bash[29727]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:59.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:16:59 smithi189 bash[29727]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:59.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:59 smithi190 bash[24979]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:16:59.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:16:59 smithi190 bash[24979]: cluster 2024-09-06T15:16:57.876338+0000 mgr.y (mgr.14631) 155 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:01 smithi189 bash[22757]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:01 smithi189 bash[22757]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:01 smithi189 bash[29727]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:01 smithi189 bash[29727]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:00 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:01.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:01 smithi190 bash[24979]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:01 smithi190 bash[24979]: cluster 2024-09-06T15:16:59.877087+0000 mgr.y (mgr.14631) 156 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:01.519 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:02.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:02 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:02 smithi189 bash[22757]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:02 smithi189 bash[22757]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:02 smithi189 bash[29727]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:02 smithi189 bash[29727]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:02 smithi190 bash[24979]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:02 smithi190 bash[24979]: audit 2024-09-06T15:17:00.956113+0000 mgr.y (mgr.14631) 157 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:02.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.891+0000 7f86fabcc640 1 -- 172.21.15.189:0/1281193320 >> v1:172.21.15.189:6790/0 conn(0x7f86f410efe0 legacy=0x7f86f41114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:02.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/1281193320 shutdown_connections 2024-09-06T15:17:02.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/1281193320 >> 172.21.15.189:0/1281193320 conn(0x7f86f40fe360 msgr2=0x7f86f4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:02.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/1281193320 shutdown_connections 2024-09-06T15:17:02.892 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/1281193320 wait complete. 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 Processor -- start 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- start start 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86f41a9800 con 0x7f86f410b440 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86f41aaa00 con 0x7f86f410efe0 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f86f41abc00 con 0x7f86f41028d0 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f3fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f86f410b440 0x7f86f41a4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:49850/0 (socket says 172.21.15.189:49850) 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f3fff640 1 -- 172.21.15.189:0/2919832411 learned_addr learned my addr 172.21.15.189:0/2919832411 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f8968640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f86f41028d0 0x7f86f41113c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:46856/0 (socket says 172.21.15.189:46856) 2024-09-06T15:17:02.894 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525719336 0 0) 0x7f86f41a9800 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86dc003520 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600237468 0 0) 0x7f86f41abc00 con 0x7f86f41028d0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f41a9800 con 0x7f86f41028d0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1752894244 0 0) 0x7f86dc003520 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86f41abc00 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f86e4001a30 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2431805537 0 0) 0x7f86f41a9800 con 0x7f86f41028d0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86dc003520 con 0x7f86f41028d0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f86e8001170 con 0x7f86f41028d0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648604229 0 0) 0x7f86f41aaa00 con 0x7f86f410efe0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86f41a9800 con 0x7f86f410efe0 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1481189607 0 0) 0x7f86f41abc00 con 0x7f86f410b440 2024-09-06T15:17:02.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 >> v1:172.21.15.189:6790/0 conn(0x7f86f41028d0 legacy=0x7f86f41113c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 >> v1:172.21.15.190:6789/0 conn(0x7f86f410efe0 legacy=0x7f86f41a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f41acea0 con 0x7f86f410b440 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86f41abe30 con 0x7f86f410b440 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f86f41ac3e0 con 0x7f86f410b440 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f86e4001cb0 con 0x7f86f410b440 2024-09-06T15:17:02.896 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f86e4005cf0 con 0x7f86f410b440 2024-09-06T15:17:02.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.895+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e0005080 con 0x7f86f410b440 2024-09-06T15:17:02.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.899+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f86e40038c0 con 0x7f86f410b440 2024-09-06T15:17:02.897 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.899+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f86e4094d40 con 0x7f86f410b440 2024-09-06T15:17:02.900 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:02.903+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f86e405dcc0 con 0x7f86f410b440 2024-09-06T15:17:03.108 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f86e0005370 con 0x7f86f410b440 2024-09-06T15:17:03.108 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86f1ffb640 1 -- 172.21.15.189:0/2919832411 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f86e4061e30 con 0x7f86f410b440 2024-09-06T15:17:03.109 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:03.109 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 >> v1:172.21.15.189:6800/1420554776 conn(0x7f86dc078400 legacy=0x7f86dc07a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 >> v1:172.21.15.189:6789/0 conn(0x7f86f410b440 legacy=0x7f86f41a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 shutdown_connections 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 >> 172.21.15.189:0/2919832411 conn(0x7f86f40fe360 msgr2=0x7f86f4100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 shutdown_connections 2024-09-06T15:17:03.111 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:03.111+0000 7f86fabcc640 1 -- 172.21.15.189:0/2919832411 wait complete. 2024-09-06T15:17:03.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:03 smithi189 bash[22757]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:03.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:03 smithi189 bash[22757]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:03.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:03 smithi189 bash[29727]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:03.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:03 smithi189 bash[29727]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:03.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:03 smithi190 bash[24979]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:03.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:03 smithi190 bash[24979]: cluster 2024-09-06T15:17:01.878538+0000 mgr.y (mgr.14631) 158 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:04.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:04 smithi189 bash[22757]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:04.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:04 smithi189 bash[22757]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:04.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:04 smithi189 bash[29727]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:04.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:04 smithi189 bash[29727]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:04.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:04 smithi190 bash[24979]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:04.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:04 smithi190 bash[24979]: audit 2024-09-06T15:17:03.115110+0000 mon.a (mon.0) 862 : audit [DBG] from='client.? v1:172.21.15.189:0/2919832411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:05.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:05 smithi189 bash[22757]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:05.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:05 smithi189 bash[22757]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:05.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:05 smithi189 bash[29727]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:05.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:05 smithi189 bash[29727]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:05.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:05 smithi190 bash[24979]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:05.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:05 smithi190 bash[24979]: cluster 2024-09-06T15:17:03.879214+0000 mgr.y (mgr.14631) 159 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:06.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:06 smithi189 bash[29727]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:06 smithi189 bash[29727]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:06 smithi189 bash[22757]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:06 smithi189 bash[22757]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:06 smithi190 bash[24979]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:06 smithi190 bash[24979]: audit 2024-09-06T15:17:05.493573+0000 mon.c (mon.2) 99 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:06.771 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:07.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:07 smithi189 bash[22757]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:07.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:07 smithi189 bash[22757]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:07 smithi189 bash[29727]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:07.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:07 smithi189 bash[29727]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:07.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:07 smithi190 bash[24979]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:07.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:07 smithi190 bash[24979]: cluster 2024-09-06T15:17:05.880625+0000 mgr.y (mgr.14631) 160 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:09.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:09 smithi189 bash[22757]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:09.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:09 smithi189 bash[22757]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:09.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:09 smithi189 bash[29727]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:09.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:09 smithi189 bash[29727]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:09.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:09 smithi190 bash[24979]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:09.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:09 smithi190 bash[24979]: cluster 2024-09-06T15:17:07.881310+0000 mgr.y (mgr.14631) 161 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:11 smithi189 bash[29727]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:11 smithi189 bash[29727]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:11 smithi189 bash[22757]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:11 smithi189 bash[22757]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:11 smithi190 bash[24979]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:11 smithi190 bash[24979]: cluster 2024-09-06T15:17:09.882006+0000 mgr.y (mgr.14631) 162 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:11.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:10 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:11.570 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:12.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:12.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:12 smithi189 bash[22757]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:12 smithi189 bash[22757]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:12 smithi189 bash[29727]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.349 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:12 smithi189 bash[29727]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:12 smithi190 bash[24979]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:12 smithi190 bash[24979]: audit 2024-09-06T15:17:10.967505+0000 mgr.y (mgr.14631) 163 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:12.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.906+0000 7f9a2d23c640 1 -- 172.21.15.189:0/478751626 >> v1:172.21.15.189:6790/0 conn(0x7f9a281155e0 legacy=0x7f9a28117aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:12.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.906+0000 7f9a2d23c640 1 -- 172.21.15.189:0/478751626 shutdown_connections 2024-09-06T15:17:12.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.906+0000 7f9a2d23c640 1 -- 172.21.15.189:0/478751626 >> 172.21.15.189:0/478751626 conn(0x7f9a28078560 msgr2=0x7f9a2807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:12.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.906+0000 7f9a2d23c640 1 -- 172.21.15.189:0/478751626 shutdown_connections 2024-09-06T15:17:12.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- 172.21.15.189:0/478751626 wait complete. 2024-09-06T15:17:12.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 Processor -- start 2024-09-06T15:17:12.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- start start 2024-09-06T15:17:12.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9a281adbc0 con 0x7f9a281155e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9a281aedc0 con 0x7f9a28108fa0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f9a281affc0 con 0x7f9a281119e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2659c640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f9a281119e0 0x7f9a281a8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:48542/0 (socket says 172.21.15.189:48542) 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2759e640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f9a281155e0 0x7f9a281ac2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39838/0 (socket says 172.21.15.189:39838) 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2659c640 1 -- 172.21.15.189:0/3848842300 learned_addr learned my addr 172.21.15.189:0/3848842300 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811898343 0 0) 0x7f9a281affc0 con 0x7f9a281119e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a10003520 con 0x7f9a281119e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824887477 0 0) 0x7f9a281adbc0 con 0x7f9a281155e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a281affc0 con 0x7f9a281155e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3259049247 0 0) 0x7f9a10003520 con 0x7f9a281119e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a281adbc0 con 0x7f9a281119e0 2024-09-06T15:17:12.910 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9a18001a30 con 0x7f9a281119e0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59480176 0 0) 0x7f9a281affc0 con 0x7f9a281155e0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a10003520 con 0x7f9a281155e0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9a20001950 con 0x7f9a281155e0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223839 0 0) 0x7f9a281aedc0 con 0x7f9a28108fa0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a281affc0 con 0x7f9a28108fa0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2308009406 0 0) 0x7f9a281adbc0 con 0x7f9a281119e0 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 >> v1:172.21.15.190:6789/0 conn(0x7f9a28108fa0 legacy=0x7f9a28114d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:12.911 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 >> v1:172.21.15.189:6789/0 conn(0x7f9a281155e0 legacy=0x7f9a281ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a281b1260 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a281addf0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a281ae3a0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f9a18001cb0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f9a18005cf0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a140050b0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.910+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f9a180038c0 con 0x7f9a281119e0 2024-09-06T15:17:12.912 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.914+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f9a18094e30 con 0x7f9a281119e0 2024-09-06T15:17:12.916 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:12.918+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f9a1805ddb0 con 0x7f9a281119e0 2024-09-06T15:17:13.120 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a140053a0 con 0x7f9a281119e0 2024-09-06T15:17:13.121 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:13.121 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:13.121 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a0ffff640 1 -- 172.21.15.189:0/3848842300 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f9a18061f20 con 0x7f9a281119e0 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 >> v1:172.21.15.189:6800/1420554776 conn(0x7f9a10078450 legacy=0x7f9a1007a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 >> v1:172.21.15.189:6790/0 conn(0x7f9a281119e0 legacy=0x7f9a281a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 shutdown_connections 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 >> 172.21.15.189:0/3848842300 conn(0x7f9a28078560 msgr2=0x7f9a28118270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 shutdown_connections 2024-09-06T15:17:13.123 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:13.122+0000 7f9a2d23c640 1 -- 172.21.15.189:0/3848842300 wait complete. 2024-09-06T15:17:13.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:13 smithi189 bash[22757]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:13.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:13 smithi189 bash[22757]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:13.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:13 smithi189 bash[29727]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:13.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:13 smithi189 bash[29727]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:13.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:13 smithi190 bash[24979]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:13.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:13 smithi190 bash[24979]: cluster 2024-09-06T15:17:11.883505+0000 mgr.y (mgr.14631) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:14.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:14 smithi189 bash[22757]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:14.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:14 smithi189 bash[22757]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:14.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:14 smithi189 bash[29727]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:14.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:14 smithi189 bash[29727]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:14.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:14 smithi190 bash[24979]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:14.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:14 smithi190 bash[24979]: audit 2024-09-06T15:17:13.127293+0000 mon.c (mon.2) 100 : audit [DBG] from='client.? v1:172.21.15.189:0/3848842300' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:15.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:15 smithi190 bash[24979]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:15.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:15 smithi190 bash[24979]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:15.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:15 smithi189 bash[29727]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:15.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:15 smithi189 bash[29727]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:15.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:15 smithi189 bash[22757]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:15.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:15 smithi189 bash[22757]: cluster 2024-09-06T15:17:13.884212+0000 mgr.y (mgr.14631) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:16.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:16 smithi190 bash[24979]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:16 smithi190 bash[24979]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:16 smithi189 bash[22757]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:16 smithi189 bash[22757]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:16 smithi189 bash[29727]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:16 smithi189 bash[29727]: audit 2024-09-06T15:17:15.365097+0000 mon.c (mon.2) 101 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:17:16.779 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:17.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:17.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:17 smithi190 bash[24979]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[22757]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: cluster 2024-09-06T15:17:15.885626+0000 mgr.y (mgr.14631) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.144338+0000 mon.c (mon.2) 102 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.145426+0000 mon.c (mon.2) 103 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:17 smithi189 bash[29727]: audit 2024-09-06T15:17:16.154205+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:17:19.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:19 smithi190 bash[24979]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:19.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:19 smithi190 bash[24979]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:19.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:19 smithi189 bash[22757]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:19.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:19 smithi189 bash[22757]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:19.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:19 smithi189 bash[29727]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:19.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:19 smithi189 bash[29727]: cluster 2024-09-06T15:17:17.886370+0000 mgr.y (mgr.14631) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.373 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:20 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:21.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:21 smithi190 bash[24979]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:21 smithi190 bash[24979]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:21 smithi190 bash[24979]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:21.373 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:21 smithi190 bash[24979]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:21.580 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[22757]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[22757]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[22757]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[22757]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[29727]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[29727]: cluster 2024-09-06T15:17:19.887079+0000 mgr.y (mgr.14631) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[29727]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:21.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:21 smithi189 bash[29727]: audit 2024-09-06T15:17:20.521508+0000 mon.c (mon.2) 104 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:22.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:22 smithi189 bash[22757]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:22 smithi189 bash[22757]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:22 smithi189 bash[29727]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:22 smithi189 bash[29727]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:22 smithi190 bash[24979]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:22 smithi190 bash[24979]: audit 2024-09-06T15:17:20.978878+0000 mgr.y (mgr.14631) 169 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:22.843 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.838+0000 7fe55b67d640 1 -- 172.21.15.189:0/1806912069 >> v1:172.21.15.189:6789/0 conn(0x7fe55410f0f0 legacy=0x7fe5541114e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:22.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/1806912069 shutdown_connections 2024-09-06T15:17:22.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/1806912069 >> 172.21.15.189:0/1806912069 conn(0x7fe5540fd210 msgr2=0x7fe5540ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:22.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/1806912069 shutdown_connections 2024-09-06T15:17:22.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/1806912069 wait complete. 2024-09-06T15:17:22.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 Processor -- start 2024-09-06T15:17:22.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- start start 2024-09-06T15:17:22.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5541a7580 con 0x7fe55410b5e0 2024-09-06T15:17:22.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5541a8780 con 0x7fe5541037d0 2024-09-06T15:17:22.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe5541a9980 con 0x7fe55410f0f0 2024-09-06T15:17:22.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe559c1a640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fe55410f0f0 0x7fe5541a5c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:59284/0 (socket says 172.21.15.189:59284) 2024-09-06T15:17:22.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe559c1a640 1 -- 172.21.15.189:0/3261567872 learned_addr learned my addr 172.21.15.189:0/3261567872 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:22.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219139267 0 0) 0x7fe5541a9980 con 0x7fe55410f0f0 2024-09-06T15:17:22.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003520 con 0x7fe55410f0f0 2024-09-06T15:17:22.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439868659 0 0) 0x7fe5541a7580 con 0x7fe55410b5e0 2024-09-06T15:17:22.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5541a9980 con 0x7fe55410b5e0 2024-09-06T15:17:22.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 147941234 0 0) 0x7fe540003520 con 0x7fe55410f0f0 2024-09-06T15:17:22.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5541a7580 con 0x7fe55410f0f0 2024-09-06T15:17:22.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3828978602 0 0) 0x7fe5541a9980 con 0x7fe55410b5e0 2024-09-06T15:17:22.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe540003520 con 0x7fe55410b5e0 2024-09-06T15:17:22.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe54c001880 con 0x7fe55410f0f0 2024-09-06T15:17:22.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe5440018f0 con 0x7fe55410b5e0 2024-09-06T15:17:22.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88307366 0 0) 0x7fe5541a8780 con 0x7fe5541037d0 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5541a9980 con 0x7fe5541037d0 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2313481148 0 0) 0x7fe5541a7580 con 0x7fe55410f0f0 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 >> v1:172.21.15.190:6789/0 conn(0x7fe5541037d0 legacy=0x7fe55410ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 >> v1:172.21.15.189:6789/0 conn(0x7fe55410b5e0 legacy=0x7fe5541a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5541aac20 con 0x7fe55410f0f0 2024-09-06T15:17:22.849 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe5541a77b0 con 0x7fe55410f0f0 2024-09-06T15:17:22.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe5541a7de0 con 0x7fe55410f0f0 2024-09-06T15:17:22.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe54c001df0 con 0x7fe55410f0f0 2024-09-06T15:17:22.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe54c004f20 con 0x7fe55410f0f0 2024-09-06T15:17:22.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5380050b0 con 0x7fe55410f0f0 2024-09-06T15:17:22.850 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.842+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe54c003970 con 0x7fe55410f0f0 2024-09-06T15:17:22.851 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.846+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe54c094e90 con 0x7fe55410f0f0 2024-09-06T15:17:22.851 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:22.850+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe54c05de10 con 0x7fe55410f0f0 2024-09-06T15:17:23.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.046+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5380053a0 con 0x7fe55410f0f0 2024-09-06T15:17:23.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe54a7fc640 1 -- 172.21.15.189:0/3261567872 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fe54c061f80 con 0x7fe55410f0f0 2024-09-06T15:17:23.048 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:23.048 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:23.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe54007c880 legacy=0x7fe54007ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:23.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 >> v1:172.21.15.189:6790/0 conn(0x7fe55410f0f0 legacy=0x7fe5541a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:23.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 shutdown_connections 2024-09-06T15:17:23.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 >> 172.21.15.189:0/3261567872 conn(0x7fe5540fd210 msgr2=0x7fe5540ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:23.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 shutdown_connections 2024-09-06T15:17:23.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:23.050+0000 7fe55b67d640 1 -- 172.21.15.189:0/3261567872 wait complete. 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[29727]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[29727]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[29727]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[29727]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[22757]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[22757]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[22757]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:23.349 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:23 smithi189 bash[22757]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:23 smithi190 bash[24979]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:23 smithi190 bash[24979]: cluster 2024-09-06T15:17:21.888573+0000 mgr.y (mgr.14631) 170 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:23 smithi190 bash[24979]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:23.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:23 smithi190 bash[24979]: audit 2024-09-06T15:17:23.054502+0000 mon.c (mon.2) 105 : audit [DBG] from='client.? v1:172.21.15.189:0/3261567872' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:25.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:25 smithi189 bash[22757]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:25.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:25 smithi189 bash[22757]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:25.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:25 smithi189 bash[29727]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:25.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:25 smithi189 bash[29727]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:25.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:25 smithi190 bash[24979]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:25.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:25 smithi190 bash[24979]: cluster 2024-09-06T15:17:23.889311+0000 mgr.y (mgr.14631) 171 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:26.708 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:27.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:27 smithi189 bash[22757]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:27.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:27 smithi189 bash[22757]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:27.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:27 smithi189 bash[29727]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:27.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:27 smithi189 bash[29727]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:27.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:27 smithi190 bash[24979]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:27.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:27 smithi190 bash[24979]: cluster 2024-09-06T15:17:25.890800+0000 mgr.y (mgr.14631) 172 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:29.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:29 smithi189 bash[22757]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:29.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:29 smithi189 bash[22757]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:29.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:29 smithi189 bash[29727]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:29.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:29 smithi189 bash[29727]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:29.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:29 smithi190 bash[24979]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:29.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:29 smithi190 bash[24979]: cluster 2024-09-06T15:17:27.891441+0000 mgr.y (mgr.14631) 173 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:30 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:31.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:31 smithi190 bash[24979]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:31 smithi190 bash[24979]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.517 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:31 smithi189 bash[22757]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:31 smithi189 bash[22757]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:31 smithi189 bash[29727]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:31.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:31 smithi189 bash[29727]: cluster 2024-09-06T15:17:29.892128+0000 mgr.y (mgr.14631) 174 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:32.495 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:32 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:32.496 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:32 smithi189 bash[22757]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.496 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:32 smithi189 bash[22757]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.496 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:32 smithi189 bash[29727]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.496 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:32 smithi189 bash[29727]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:32 smithi190 bash[24979]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:32 smithi190 bash[24979]: audit 2024-09-06T15:17:30.990236+0000 mgr.y (mgr.14631) 175 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.650+0000 7f58d31ea640 1 -- 172.21.15.189:0/1333070431 >> v1:172.21.15.189:6790/0 conn(0x7f58cc109a50 legacy=0x7f58cc10be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.650+0000 7f58d31ea640 1 -- 172.21.15.189:0/1333070431 shutdown_connections 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.650+0000 7f58d31ea640 1 -- 172.21.15.189:0/1333070431 >> 172.21.15.189:0/1333070431 conn(0x7f58cc078d00 msgr2=0x7f58cc079110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.650+0000 7f58d31ea640 1 -- 172.21.15.189:0/1333070431 shutdown_connections 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.650+0000 7f58d31ea640 1 -- 172.21.15.189:0/1333070431 wait complete. 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 Processor -- start 2024-09-06T15:17:32.648 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- start start 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f58cc1a9900 con 0x7f58cc101280 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f58cc1aab00 con 0x7f58cc10d650 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f58cc1abd00 con 0x7f58cc109a50 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d0f86640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f58cc101280 0x7f58cc10bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:33224/0 (socket says 172.21.15.189:33224) 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58cbfff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f58cc109a50 0x7f58cc10c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:33690/0 (socket says 172.21.15.189:33690) 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d0f86640 1 -- 172.21.15.189:0/2175865158 learned_addr learned my addr 172.21.15.189:0/2175865158 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315813072 0 0) 0x7f58cc1abd00 con 0x7f58cc109a50 2024-09-06T15:17:32.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b4004630 con 0x7f58cc109a50 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200825882 0 0) 0x7f58cc1a9900 con 0x7f58cc101280 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc1abd00 con 0x7f58cc101280 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1375158765 0 0) 0x7f58b4004630 con 0x7f58cc109a50 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58cc1a9900 con 0x7f58cc109a50 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f58c0001af0 con 0x7f58cc109a50 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 288051326 0 0) 0x7f58cc1abd00 con 0x7f58cc101280 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58b4004630 con 0x7f58cc101280 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f58bc0018b0 con 0x7f58cc101280 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701758505 0 0) 0x7f58cc1aab00 con 0x7f58cc10d650 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc1abd00 con 0x7f58cc10d650 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4231894113 0 0) 0x7f58cc1a9900 con 0x7f58cc109a50 2024-09-06T15:17:32.651 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 >> v1:172.21.15.190:6789/0 conn(0x7f58cc10d650 legacy=0x7f58cc1a7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 >> v1:172.21.15.189:6789/0 conn(0x7f58cc101280 legacy=0x7f58cc10bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc1acfa0 con 0x7f58cc109a50 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc1abf30 con 0x7f58cc109a50 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f58c0004670 con 0x7f58cc109a50 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f58cc1ac560 con 0x7f58cc109a50 2024-09-06T15:17:32.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f58c0004e40 con 0x7f58cc109a50 2024-09-06T15:17:32.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58cc10cd90 con 0x7f58cc109a50 2024-09-06T15:17:32.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.654+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f58c00037d0 con 0x7f58cc109a50 2024-09-06T15:17:32.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.658+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f58c0094e10 con 0x7f58cc109a50 2024-09-06T15:17:32.655 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.662+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f58c005ddd0 con 0x7f58cc109a50 2024-09-06T15:17:32.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f58cc112b70 con 0x7f58cc109a50 2024-09-06T15:17:32.857 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58c9ffb640 1 -- 172.21.15.189:0/2175865158 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f58c0061f40 con 0x7f58cc109a50 2024-09-06T15:17:32.857 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:32.857 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:32.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 >> v1:172.21.15.189:6800/1420554776 conn(0x7f58b4078470 legacy=0x7f58b407a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:32.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 >> v1:172.21.15.189:6790/0 conn(0x7f58cc109a50 legacy=0x7f58cc10c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:32.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 shutdown_connections 2024-09-06T15:17:32.859 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 >> 172.21.15.189:0/2175865158 conn(0x7f58cc078d00 msgr2=0x7f58cc1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:32.860 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 shutdown_connections 2024-09-06T15:17:32.860 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:32.862+0000 7f58d31ea640 1 -- 172.21.15.189:0/2175865158 wait complete. 2024-09-06T15:17:33.530 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[29727]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.530 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[29727]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.530 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[29727]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:33.530 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[29727]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:33.531 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[22757]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.531 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[22757]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.531 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[22757]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:33.531 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:33 smithi189 bash[22757]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:33 smithi190 bash[24979]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:33 smithi190 bash[24979]: cluster 2024-09-06T15:17:31.893541+0000 mgr.y (mgr.14631) 176 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:33 smithi190 bash[24979]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:33 smithi190 bash[24979]: audit 2024-09-06T15:17:32.863809+0000 mon.c (mon.2) 106 : audit [DBG] from='client.? v1:172.21.15.189:0/2175865158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:35.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:35 smithi189 bash[22757]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:35.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:35 smithi189 bash[22757]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:35.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:35 smithi189 bash[29727]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:35.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:35 smithi189 bash[29727]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:35.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:35 smithi190 bash[24979]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:35.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:35 smithi190 bash[24979]: cluster 2024-09-06T15:17:33.894256+0000 mgr.y (mgr.14631) 177 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:36.532 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:36.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:36 smithi189 bash[22757]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:36.544 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:36 smithi189 bash[22757]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:36.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:36 smithi189 bash[29727]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:36.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:36 smithi189 bash[29727]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:36.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:36 smithi190 bash[24979]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:36.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:36 smithi190 bash[24979]: audit 2024-09-06T15:17:35.548657+0000 mon.c (mon.2) 107 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:37.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:37 smithi189 bash[22757]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:37.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:37 smithi189 bash[22757]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:37.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:37 smithi189 bash[29727]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:37.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:37 smithi189 bash[29727]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:37.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:37 smithi190 bash[24979]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:37.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:37 smithi190 bash[24979]: cluster 2024-09-06T15:17:35.895750+0000 mgr.y (mgr.14631) 178 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:39.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:39 smithi189 bash[22757]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:39.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:39 smithi189 bash[22757]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:39.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:39 smithi189 bash[29727]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:39.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:39 smithi189 bash[29727]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:39.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:39 smithi190 bash[24979]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:39.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:39 smithi190 bash[24979]: cluster 2024-09-06T15:17:37.896474+0000 mgr.y (mgr.14631) 179 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.341 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:41.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:41 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:41.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:41 smithi190 bash[24979]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:41 smithi190 bash[24979]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:41 smithi189 bash[22757]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.438 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:41 smithi189 bash[22757]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:41 smithi189 bash[29727]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:41.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:41 smithi189 bash[29727]: cluster 2024-09-06T15:17:39.897167+0000 mgr.y (mgr.14631) 180 : cluster [DBG] pgmap v118: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:42.461 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:42 smithi189 bash[22757]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.461 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:42 smithi189 bash[22757]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.461 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:42 smithi189 bash[29727]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.461 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:42 smithi189 bash[29727]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.462 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:42 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:42.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/4033663611 >> v1:172.21.15.189:6790/0 conn(0x7f50e01028c0 legacy=0x7f50e0102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:42.620 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/4033663611 shutdown_connections 2024-09-06T15:17:42.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/4033663611 >> 172.21.15.189:0/4033663611 conn(0x7f50e00fe330 msgr2=0x7f50e0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:42.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/4033663611 shutdown_connections 2024-09-06T15:17:42.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/4033663611 wait complete. 2024-09-06T15:17:42.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 Processor -- start 2024-09-06T15:17:42.621 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- start start 2024-09-06T15:17:42.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:42 smithi190 bash[24979]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.622 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:42 smithi190 bash[24979]: audit 2024-09-06T15:17:41.001537+0000 mgr.y (mgr.14631) 181 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f50e01a75b0 con 0x7f50e01028c0 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f50e01a87b0 con 0x7f50e010efd0 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f50e01a99b0 con 0x7f50e010b430 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50de7fc640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f50e010b430 0x7f50e01a2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:58876/0 (socket says 172.21.15.189:58876) 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50de7fc640 1 -- 172.21.15.189:0/2467931608 learned_addr learned my addr 172.21.15.189:0/2467931608 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:42.623 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516877559 0 0) 0x7f50e01a99b0 con 0x7f50e010b430 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c8003520 con 0x7f50e010b430 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289196207 0 0) 0x7f50e01a75b0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e01a99b0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3892013282 0 0) 0x7f50c8003520 con 0x7f50e010b430 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e01a75b0 con 0x7f50e010b430 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f50d4001a30 con 0x7f50e010b430 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924897904 0 0) 0x7f50e01a87b0 con 0x7f50e010efd0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c8003520 con 0x7f50e010efd0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2282373755 0 0) 0x7f50e01a99b0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e01a87b0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f50d00015d0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3153509011 0 0) 0x7f50e01a87b0 con 0x7f50e01028c0 2024-09-06T15:17:42.624 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 >> v1:172.21.15.189:6790/0 conn(0x7f50e010b430 legacy=0x7f50e01a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 >> v1:172.21.15.190:6789/0 conn(0x7f50e010efd0 legacy=0x7f50e01a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e01aac50 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50e01a77e0 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50e01a7d90 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f50d0001170 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f50d0004a50 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.626+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc0050b0 con 0x7f50e01028c0 2024-09-06T15:17:42.625 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.630+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f50d0001a20 con 0x7f50e01028c0 2024-09-06T15:17:42.626 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.630+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f50d0093a20 con 0x7f50e01028c0 2024-09-06T15:17:42.628 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.634+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f50d005c9a0 con 0x7f50e01028c0 2024-09-06T15:17:42.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.830+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50cc0053a0 con 0x7f50e01028c0 2024-09-06T15:17:42.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50c7fff640 1 -- 172.21.15.189:0/2467931608 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f50d0060b10 con 0x7f50e01028c0 2024-09-06T15:17:42.828 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:42.828 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 >> v1:172.21.15.189:6800/1420554776 conn(0x7f50c8078320 legacy=0x7f50c807a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 >> v1:172.21.15.189:6789/0 conn(0x7f50e01028c0 legacy=0x7f50e010e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 shutdown_connections 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 >> 172.21.15.189:0/2467931608 conn(0x7f50e00fe330 msgr2=0x7f50e01060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 shutdown_connections 2024-09-06T15:17:42.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:42.834+0000 7f50e5290640 1 -- 172.21.15.189:0/2467931608 wait complete. 2024-09-06T15:17:43.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[29727]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[29727]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[29727]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:43.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[29727]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:43.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[22757]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[22757]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[22757]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:43.600 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:43 smithi189 bash[22757]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:43.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:43 smithi190 bash[24979]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:43 smithi190 bash[24979]: cluster 2024-09-06T15:17:41.898655+0000 mgr.y (mgr.14631) 182 : cluster [DBG] pgmap v119: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:43.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:43 smithi190 bash[24979]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:43.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:43 smithi190 bash[24979]: audit 2024-09-06T15:17:42.834709+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? v1:172.21.15.189:0/2467931608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:45.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:45 smithi189 bash[22757]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:45.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:45 smithi189 bash[22757]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:45.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:45 smithi189 bash[29727]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:45.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:45 smithi189 bash[29727]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:45.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:45 smithi190 bash[24979]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:45.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:45 smithi190 bash[24979]: cluster 2024-09-06T15:17:43.899299+0000 mgr.y (mgr.14631) 183 : cluster [DBG] pgmap v120: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:46.440 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:47.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:47 smithi189 bash[29727]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:47.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:47 smithi189 bash[29727]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:47.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:47 smithi189 bash[22757]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:47.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:47 smithi189 bash[22757]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:47.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:47 smithi190 bash[24979]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:47.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:47 smithi190 bash[24979]: cluster 2024-09-06T15:17:45.900703+0000 mgr.y (mgr.14631) 184 : cluster [DBG] pgmap v121: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:49.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:49 smithi189 bash[22757]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:49.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:49 smithi189 bash[22757]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:49.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:49 smithi189 bash[29727]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:49.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:49 smithi189 bash[29727]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:49.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:49 smithi190 bash[24979]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:49.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:49 smithi190 bash[24979]: cluster 2024-09-06T15:17:47.901382+0000 mgr.y (mgr.14631) 185 : cluster [DBG] pgmap v122: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.242 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:17:51.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:17:51 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:17:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:51 smithi190 bash[24979]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:51 smithi190 bash[24979]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:51 smithi190 bash[24979]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:51.371 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:51 smithi190 bash[24979]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[22757]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[22757]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[22757]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[22757]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[29727]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[29727]: cluster 2024-09-06T15:17:49.902064+0000 mgr.y (mgr.14631) 186 : cluster [DBG] pgmap v123: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[29727]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:51.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:51 smithi189 bash[29727]: audit 2024-09-06T15:17:50.576224+0000 mon.c (mon.2) 108 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3444681166 >> v1:172.21.15.189:6789/0 conn(0x7f2a0c1028d0 legacy=0x7f2a0c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3444681166 shutdown_connections 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3444681166 >> 172.21.15.189:0/3444681166 conn(0x7f2a0c0fe360 msgr2=0x7f2a0c100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3444681166 shutdown_connections 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3444681166 wait complete. 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 Processor -- start 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- start start 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a0c1a9700 con 0x7f2a0c10b440 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a0c1aa900 con 0x7f2a0c1028d0 2024-09-06T15:17:52.357 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2a0c1abb00 con 0x7f2a0c10efe0 2024-09-06T15:17:52.358 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a12a40640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f2a0c10efe0 0x7f2a0c1a7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:54476/0 (socket says 172.21.15.189:54476) 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a11a3e640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2a0c10b440 0x7f2a0c1a4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:36218/0 (socket says 172.21.15.189:36218) 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a12a40640 1 -- 172.21.15.189:0/3781634532 learned_addr learned my addr 172.21.15.189:0/3781634532 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475974680 0 0) 0x7f2a0c1abb00 con 0x7f2a0c10efe0 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29f8001fe0 con 0x7f2a0c10efe0 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456152922 0 0) 0x7f2a0c1a9700 con 0x7f2a0c10b440 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a0c1abb00 con 0x7f2a0c10b440 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 780413333 0 0) 0x7f29f8001fe0 con 0x7f2a0c10efe0 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a0c1a9700 con 0x7f2a0c10efe0 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2a04001d30 con 0x7f2a0c10efe0 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3317859906 0 0) 0x7f2a0c1abb00 con 0x7f2a0c10b440 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29f8001fe0 con 0x7f2a0c10b440 2024-09-06T15:17:52.359 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f29fc0013b0 con 0x7f2a0c10b440 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877354275 0 0) 0x7f2a0c1aa900 con 0x7f2a0c1028d0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a0c1abb00 con 0x7f2a0c1028d0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4216216528 0 0) 0x7f2a0c1a9700 con 0x7f2a0c10efe0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 >> v1:172.21.15.190:6789/0 conn(0x7f2a0c1028d0 legacy=0x7f2a0c0769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 >> v1:172.21.15.189:6789/0 conn(0x7f2a0c10b440 legacy=0x7f2a0c1a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c1acda0 con 0x7f2a0c10efe0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c1abd30 con 0x7f2a0c10efe0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a0c1ac360 con 0x7f2a0c10efe0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f2a04002030 con 0x7f2a0c10efe0 2024-09-06T15:17:52.360 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2a04006070 con 0x7f2a0c10efe0 2024-09-06T15:17:52.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.362+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f00050b0 con 0x7f2a0c10efe0 2024-09-06T15:17:52.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.366+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f2a04003c40 con 0x7f2a0c10efe0 2024-09-06T15:17:52.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.366+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f2a04095110 con 0x7f2a0c10efe0 2024-09-06T15:17:52.364 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.370+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f2a0405e090 con 0x7f2a0c10efe0 2024-09-06T15:17:52.564 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.566+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f29f00053a0 con 0x7f2a0c10efe0 2024-09-06T15:17:52.564 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a037fe640 1 -- 172.21.15.189:0/3781634532 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f2a04062200 con 0x7f2a0c10efe0 2024-09-06T15:17:52.565 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:17:52.565 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:17:52.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 >> v1:172.21.15.189:6800/1420554776 conn(0x7f29f8078350 legacy=0x7f29f807a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:52.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 >> v1:172.21.15.189:6790/0 conn(0x7f2a0c10efe0 legacy=0x7f2a0c1a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:17:52.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 shutdown_connections 2024-09-06T15:17:52.567 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 >> 172.21.15.189:0/3781634532 conn(0x7f2a0c0fe360 msgr2=0x7f2a0c1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:17:52.567 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 shutdown_connections 2024-09-06T15:17:52.567 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:17:52.570+0000 7f2a144a3640 1 -- 172.21.15.189:0/3781634532 wait complete. 2024-09-06T15:17:52.576 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:52 smithi189 bash[22757]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:52.576 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:52 smithi189 bash[22757]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:52.576 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:17:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:17:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:17:52.577 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:52 smithi189 bash[29727]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:52.577 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:52 smithi189 bash[29727]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:52.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:52 smithi190 bash[24979]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:52.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:52 smithi190 bash[24979]: audit 2024-09-06T15:17:51.003440+0000 mgr.y (mgr.14631) 187 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[22757]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[22757]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[22757]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[22757]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[29727]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[29727]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[29727]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:53.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:53 smithi189 bash[29727]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:53.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:53 smithi190 bash[24979]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:53 smithi190 bash[24979]: cluster 2024-09-06T15:17:51.903561+0000 mgr.y (mgr.14631) 188 : cluster [DBG] pgmap v124: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:53.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:53 smithi190 bash[24979]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:53.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:53 smithi190 bash[24979]: audit 2024-09-06T15:17:52.570541+0000 mon.c (mon.2) 109 : audit [DBG] from='client.? v1:172.21.15.189:0/3781634532' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:17:55.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:55 smithi189 bash[22757]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:55.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:55 smithi189 bash[22757]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:55.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:55 smithi189 bash[29727]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:55.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:55 smithi189 bash[29727]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:55.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:55 smithi190 bash[24979]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:55.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:55 smithi190 bash[24979]: cluster 2024-09-06T15:17:53.904272+0000 mgr.y (mgr.14631) 189 : cluster [DBG] pgmap v125: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:56.208 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:17:57.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:57 smithi189 bash[22757]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:57.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:57 smithi189 bash[22757]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:57.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:57 smithi189 bash[29727]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:57.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:57 smithi189 bash[29727]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:57.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:57 smithi190 bash[24979]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:57.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:57 smithi190 bash[24979]: cluster 2024-09-06T15:17:55.905686+0000 mgr.y (mgr.14631) 190 : cluster [DBG] pgmap v126: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:17:59.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:59 smithi189 bash[22757]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:59.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:17:59 smithi189 bash[22757]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:59.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:59 smithi189 bash[29727]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:59.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:17:59 smithi189 bash[29727]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:59.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:59 smithi190 bash[24979]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:17:59.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:17:59 smithi190 bash[24979]: cluster 2024-09-06T15:17:57.906360+0000 mgr.y (mgr.14631) 191 : cluster [DBG] pgmap v127: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.004 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:01.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:01 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:01.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:01 smithi190 bash[24979]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.370 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:01 smithi190 bash[24979]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:01 smithi189 bash[22757]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:01 smithi189 bash[22757]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:01 smithi189 bash[29727]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:01.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:01 smithi189 bash[29727]: cluster 2024-09-06T15:17:59.907100+0000 mgr.y (mgr.14631) 192 : cluster [DBG] pgmap v128: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:02.233 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/122159961 >> v1:172.21.15.189:6789/0 conn(0x7f752c10d650 legacy=0x7f752c10fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:02.233 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/122159961 shutdown_connections 2024-09-06T15:18:02.233 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/122159961 >> 172.21.15.189:0/122159961 conn(0x7f752c100530 msgr2=0x7f752c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:02.233 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/122159961 shutdown_connections 2024-09-06T15:18:02.233 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/122159961 wait complete. 2024-09-06T15:18:02.234 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 Processor -- start 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- start start 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f752c1a9690 con 0x7f752c1111f0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f752c1aa890 con 0x7f752c10d650 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f752c1aba90 con 0x7f752c104ae0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f75310b2640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f752c1111f0 0x7f752c1a7d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:40680/0 (socket says 172.21.15.189:40680) 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f75310b2640 1 -- 172.21.15.189:0/2749878895 learned_addr learned my addr 172.21.15.189:0/2749878895 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f75308b1640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f752c104ae0 0x7f752c110810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:39434/0 (socket says 172.21.15.189:39434) 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866661980 0 0) 0x7f752c1a9690 con 0x7f752c1111f0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7514003520 con 0x7f752c1111f0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524486437 0 0) 0x7f752c1aba90 con 0x7f752c104ae0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f752c1a9690 con 0x7f752c104ae0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3282705104 0 0) 0x7f7514003520 con 0x7f752c1111f0 2024-09-06T15:18:02.235 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f752c1aba90 con 0x7f752c1111f0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f75240015c0 con 0x7f752c1111f0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3315888502 0 0) 0x7f752c1a9690 con 0x7f752c104ae0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7514003520 con 0x7f752c104ae0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f7520001830 con 0x7f752c104ae0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973918429 0 0) 0x7f752c1aa890 con 0x7f752c10d650 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f752c1a9690 con 0x7f752c10d650 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3009861268 0 0) 0x7f752c1aba90 con 0x7f752c1111f0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 >> v1:172.21.15.189:6790/0 conn(0x7f752c104ae0 legacy=0x7f752c110810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 >> v1:172.21.15.190:6789/0 conn(0x7f752c10d650 legacy=0x7f752c1a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c1acd30 con 0x7f752c1111f0 2024-09-06T15:18:02.236 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f752c1a98c0 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f752c1a9ef0 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f7524003de0 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.238+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f7524005e30 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.242+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f7524003970 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.242+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75180050b0 con 0x7f752c1111f0 2024-09-06T15:18:02.237 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.242+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f7524094ff0 con 0x7f752c1111f0 2024-09-06T15:18:02.241 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.246+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f752405df70 con 0x7f752c1111f0 2024-09-06T15:18:02.449 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.454+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f75180053a0 con 0x7f752c1111f0 2024-09-06T15:18:02.450 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.454+0000 7f7529ffb640 1 -- 172.21.15.189:0/2749878895 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f75240620e0 con 0x7f752c1111f0 2024-09-06T15:18:02.450 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:02.450 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:02.452 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 >> v1:172.21.15.189:6800/1420554776 conn(0x7f7514078490 legacy=0x7f751407a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:02.452 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 >> v1:172.21.15.189:6789/0 conn(0x7f752c1111f0 legacy=0x7f752c1a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:02.453 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 shutdown_connections 2024-09-06T15:18:02.453 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 >> 172.21.15.189:0/2749878895 conn(0x7f752c100530 msgr2=0x7f752c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:02.453 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 shutdown_connections 2024-09-06T15:18:02.453 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:02.458+0000 7f7532b15640 1 -- 172.21.15.189:0/2749878895 wait complete. 2024-09-06T15:18:02.463 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:02 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:02.463 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:02 smithi189 bash[22757]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:02.463 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:02 smithi189 bash[22757]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:02.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:02 smithi189 bash[29727]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:02.464 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:02 smithi189 bash[29727]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:02.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:02 smithi190 bash[24979]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:02.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:02 smithi190 bash[24979]: audit 2024-09-06T15:18:01.013910+0000 mgr.y (mgr.14631) 193 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[22757]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[22757]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[22757]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[22757]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[29727]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[29727]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[29727]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:03.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:03 smithi189 bash[29727]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:03.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:03 smithi190 bash[24979]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:03 smithi190 bash[24979]: cluster 2024-09-06T15:18:01.908528+0000 mgr.y (mgr.14631) 194 : cluster [DBG] pgmap v129: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:03.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:03 smithi190 bash[24979]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:03.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:03 smithi190 bash[24979]: audit 2024-09-06T15:18:02.456458+0000 mon.a (mon.0) 865 : audit [DBG] from='client.? v1:172.21.15.189:0/2749878895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:05.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:05 smithi189 bash[22757]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:05.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:05 smithi189 bash[22757]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:05.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:05 smithi189 bash[29727]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:05.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:05 smithi189 bash[29727]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:05.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:05 smithi190 bash[24979]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:05.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:05 smithi190 bash[24979]: cluster 2024-09-06T15:18:03.909251+0000 mgr.y (mgr.14631) 195 : cluster [DBG] pgmap v130: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:06.101 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:06 smithi189 bash[29727]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:06.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:06 smithi189 bash[29727]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:06 smithi189 bash[22757]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:06.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:06 smithi189 bash[22757]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:06.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:06 smithi190 bash[24979]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:06.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:06 smithi190 bash[24979]: audit 2024-09-06T15:18:05.603463+0000 mon.c (mon.2) 110 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:07.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:07 smithi189 bash[22757]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:07.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:07 smithi189 bash[22757]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:07.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:07 smithi189 bash[29727]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:07.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:07 smithi189 bash[29727]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:07.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:07 smithi190 bash[24979]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:07.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:07 smithi190 bash[24979]: cluster 2024-09-06T15:18:05.910659+0000 mgr.y (mgr.14631) 196 : cluster [DBG] pgmap v131: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:09.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:09 smithi189 bash[22757]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:09.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:09 smithi189 bash[22757]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:09.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:09 smithi189 bash[29727]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:09.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:09 smithi189 bash[29727]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:09.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:09 smithi190 bash[24979]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:09.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:09 smithi190 bash[24979]: cluster 2024-09-06T15:18:07.911323+0000 mgr.y (mgr.14631) 197 : cluster [DBG] pgmap v132: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:10.907 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:11.282 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:11 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:11.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:11 smithi189 bash[22757]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:11.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:11 smithi189 bash[22757]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:11.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:11 smithi189 bash[29727]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:11.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:11 smithi189 bash[29727]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:11.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:11 smithi190 bash[24979]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:11.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:11 smithi190 bash[24979]: cluster 2024-09-06T15:18:09.912034+0000 mgr.y (mgr.14631) 198 : cluster [DBG] pgmap v133: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:12.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- 172.21.15.189:0/389224814 >> v1:172.21.15.189:6790/0 conn(0x7f8f1c10dee0 legacy=0x7f8f1c1103a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:12.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- 172.21.15.189:0/389224814 shutdown_connections 2024-09-06T15:18:12.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- 172.21.15.189:0/389224814 >> 172.21.15.189:0/389224814 conn(0x7f8f1c078cc0 msgr2=0x7f8f1c0790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:12.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- 172.21.15.189:0/389224814 shutdown_connections 2024-09-06T15:18:12.162 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- 172.21.15.189:0/389224814 wait complete. 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 Processor -- start 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- start start 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8f1c106dc0 con 0x7f8f1c10a340 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8f1c106fb0 con 0x7f8f1c10dee0 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f24048640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f8f1c1a9ad0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f215e3640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f8f1c10a340 0x7f8f1c105410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:57902/0 (socket says 172.21.15.189:57902) 2024-09-06T15:18:12.164 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f215e3640 1 -- 172.21.15.189:0/3124889250 learned_addr learned my addr 172.21.15.189:0/3124889250 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327154751 0 0) 0x7f8f1c1a9ad0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f08003520 con 0x7f8f1c1073f0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995475643 0 0) 0x7f8f1c106dc0 con 0x7f8f1c10a340 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.165+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f1c1a9ad0 con 0x7f8f1c10a340 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2160711596 0 0) 0x7f8f08003520 con 0x7f8f1c1073f0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f1c106dc0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8f180018f0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899126115 0 0) 0x7f8f1c115340 con 0x7f8f1c10dee0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f08003520 con 0x7f8f1c10dee0 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3583368028 0 0) 0x7f8f1c1a9ad0 con 0x7f8f1c10a340 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f1c115340 con 0x7f8f1c10a340 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8f0c0018b0 con 0x7f8f1c10a340 2024-09-06T15:18:12.165 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1122280405 0 0) 0x7f8f1c106dc0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 >> v1:172.21.15.190:6789/0 conn(0x7f8f1c10dee0 legacy=0x7f8f1c1a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 >> v1:172.21.15.189:6789/0 conn(0x7f8f1c10a340 legacy=0x7f8f1c105410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c1aad70 con 0x7f8f1c1073f0 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c1a9d00 con 0x7f8f1c1073f0 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f1c1aa330 con 0x7f8f1c1073f0 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f8f18003a60 con 0x7f8f1c1073f0 2024-09-06T15:18:12.166 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f8f18004990 con 0x7f8f1c1073f0 2024-09-06T15:18:12.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f000050b0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f8f180035f0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.167 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.169+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f8f180939e0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.170 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.173+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f8f1805c9a0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.347 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:12 smithi189 bash[22757]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:12.348 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:12 smithi189 bash[22757]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:12.348 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:12.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:12 smithi189 bash[29727]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:12.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:12 smithi189 bash[29727]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:12.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.373+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f000053a0 con 0x7f8f1c1073f0 2024-09-06T15:18:12.371 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.373+0000 7f8f12ffd640 1 -- 172.21.15.189:0/3124889250 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f8f18060b10 con 0x7f8f1c1073f0 2024-09-06T15:18:12.371 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:12.371 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:12.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 >> v1:172.21.15.189:6800/1420554776 conn(0x7f8f08078420 legacy=0x7f8f0807a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:12.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 >> v1:172.21.15.189:6790/0 conn(0x7f8f1c1073f0 legacy=0x7f8f1c104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:12.373 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 shutdown_connections 2024-09-06T15:18:12.374 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 >> 172.21.15.189:0/3124889250 conn(0x7f8f1c078cc0 msgr2=0x7f8f1c108470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:12.374 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 shutdown_connections 2024-09-06T15:18:12.374 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:12.377+0000 7f8f24048640 1 -- 172.21.15.189:0/3124889250 wait complete. 2024-09-06T15:18:12.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:12 smithi190 bash[24979]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:12.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:12 smithi190 bash[24979]: audit 2024-09-06T15:18:11.025252+0000 mgr.y (mgr.14631) 199 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:13.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[22757]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[22757]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[22757]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:13.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[22757]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:13.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[29727]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[29727]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[29727]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:13.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:13 smithi189 bash[29727]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:13 smithi190 bash[24979]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:13 smithi190 bash[24979]: cluster 2024-09-06T15:18:11.913556+0000 mgr.y (mgr.14631) 200 : cluster [DBG] pgmap v134: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:13 smithi190 bash[24979]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:13.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:13 smithi190 bash[24979]: audit 2024-09-06T15:18:12.377953+0000 mon.c (mon.2) 111 : audit [DBG] from='client.? v1:172.21.15.189:0/3124889250' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:15.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:15 smithi189 bash[22757]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:15.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:15 smithi189 bash[22757]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:15.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:15 smithi189 bash[29727]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:15.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:15 smithi189 bash[29727]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:15.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:15 smithi190 bash[24979]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:15.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:15 smithi190 bash[24979]: cluster 2024-09-06T15:18:13.914261+0000 mgr.y (mgr.14631) 201 : cluster [DBG] pgmap v135: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:16.041 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[22757]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:17.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:17 smithi189 bash[29727]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:17.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: cluster 2024-09-06T15:18:15.915719+0000 mgr.y (mgr.14631) 202 : cluster [DBG] pgmap v136: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:17.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:16.466077+0000 mon.c (mon.2) 112 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:18:17.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.246117+0000 mon.c (mon.2) 113 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:18:17.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.247380+0000 mon.c (mon.2) 114 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:18:17.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:17.621 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:17 smithi190 bash[24979]: audit 2024-09-06T15:18:17.256080+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:18:19.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:19 smithi189 bash[22757]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:19.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:19 smithi189 bash[22757]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:19.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:19 smithi189 bash[29727]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:19.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:19 smithi189 bash[29727]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:19.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:19 smithi190 bash[24979]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:19.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:19 smithi190 bash[24979]: cluster 2024-09-06T15:18:17.916540+0000 mgr.y (mgr.14631) 203 : cluster [DBG] pgmap v137: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:20.843 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:21.312 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:21 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[22757]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[22757]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[22757]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:21.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[22757]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[29727]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[29727]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.599 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[29727]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:21.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:21 smithi189 bash[29727]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:21.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:21 smithi190 bash[24979]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:21 smithi190 bash[24979]: cluster 2024-09-06T15:18:19.917280+0000 mgr.y (mgr.14631) 204 : cluster [DBG] pgmap v138: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-06T15:18:21.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:21 smithi190 bash[24979]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:21.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:21 smithi190 bash[24979]: audit 2024-09-06T15:18:20.631138+0000 mon.c (mon.2) 115 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- 172.21.15.189:0/3725951345 >> v1:172.21.15.189:6789/0 conn(0x7fe6ec10d780 legacy=0x7fe6ec10fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- 172.21.15.189:0/3725951345 shutdown_connections 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- 172.21.15.189:0/3725951345 >> 172.21.15.189:0/3725951345 conn(0x7fe6ec077bf0 msgr2=0x7fe6ec078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- 172.21.15.189:0/3725951345 shutdown_connections 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- 172.21.15.189:0/3725951345 wait complete. 2024-09-06T15:18:22.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 Processor -- start 2024-09-06T15:18:22.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.045+0000 7fe6f4723640 1 -- start start 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe6ec1a9900 con 0x7fe6ec10d780 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe6ec1aab00 con 0x7fe6ec111290 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe6ec1abd00 con 0x7fe6ec101270 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f24bf640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fe6ec101270 0x7fe6ec10cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:56682/0 (socket says 172.21.15.189:56682) 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f24bf640 1 -- 172.21.15.189:0/3075319542 learned_addr learned my addr 172.21.15.189:0/3075319542 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:22.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f1cbe640 1 --1- 172.21.15.189:0/3075319542 >> v1:172.21.15.189:6789/0 conn(0x7fe6ec10d780 0x7fe6ec1a46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:39262/0 (socket says 172.21.15.189:39262) 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3716071712 0 0) 0x7fe6ec1a9900 con 0x7fe6ec10d780 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d8003520 con 0x7fe6ec10d780 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858091970 0 0) 0x7fe6ec1abd00 con 0x7fe6ec101270 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec1a9900 con 0x7fe6ec101270 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3520261645 0 0) 0x7fe6d8003520 con 0x7fe6ec10d780 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec1abd00 con 0x7fe6ec10d780 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3461755005 0 0) 0x7fe6ec1a9900 con 0x7fe6ec101270 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6d8003520 con 0x7fe6ec101270 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe6e8001af0 con 0x7fe6ec10d780 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe6dc0018d0 con 0x7fe6ec101270 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684823477 0 0) 0x7fe6ec1aab00 con 0x7fe6ec111290 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec1a9900 con 0x7fe6ec111290 2024-09-06T15:18:22.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3692516914 0 0) 0x7fe6ec1abd00 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 >> v1:172.21.15.189:6790/0 conn(0x7fe6ec101270 legacy=0x7fe6ec10cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 >> v1:172.21.15.190:6789/0 conn(0x7fe6ec111290 legacy=0x7fe6ec1a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec1acfa0 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec1a9b30 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6ec1aa0e0 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe6e8001d20 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe6e8004c40 con 0x7fe6ec10d780 2024-09-06T15:18:22.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d00050b0 con 0x7fe6ec10d780 2024-09-06T15:18:22.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe6e8004e00 con 0x7fe6ec10d780 2024-09-06T15:18:22.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.049+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe6e8094ce0 con 0x7fe6ec10d780 2024-09-06T15:18:22.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.053+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe6e805dc60 con 0x7fe6ec10d780 2024-09-06T15:18:22.256 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe6d00053a0 con 0x7fe6ec10d780 2024-09-06T15:18:22.257 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6e37fe640 1 -- 172.21.15.189:0/3075319542 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fe6e8061dd0 con 0x7fe6ec10d780 2024-09-06T15:18:22.257 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:22.257 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:22.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe6d8078490 legacy=0x7fe6d807a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:22.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 >> v1:172.21.15.189:6789/0 conn(0x7fe6ec10d780 legacy=0x7fe6ec1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:22.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 shutdown_connections 2024-09-06T15:18:22.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 >> 172.21.15.189:0/3075319542 conn(0x7fe6ec077bf0 msgr2=0x7fe6ec1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:22.259 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 shutdown_connections 2024-09-06T15:18:22.260 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:22.261+0000 7fe6f4723640 1 -- 172.21.15.189:0/3075319542 wait complete. 2024-09-06T15:18:22.270 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:22.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[22757]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[22757]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[22757]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[22757]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[29727]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[29727]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[29727]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:22.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:22 smithi189 bash[29727]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:22 smithi190 bash[24979]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:22 smithi190 bash[24979]: audit 2024-09-06T15:18:21.036463+0000 mgr.y (mgr.14631) 205 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:22 smithi190 bash[24979]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:22.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:22 smithi190 bash[24979]: audit 2024-09-06T15:18:22.263915+0000 mon.a (mon.0) 867 : audit [DBG] from='client.? v1:172.21.15.189:0/3075319542' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:23.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:23 smithi189 bash[22757]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:23.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:23 smithi189 bash[22757]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:23.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:23 smithi189 bash[29727]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:23.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:23 smithi189 bash[29727]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:23 smithi190 bash[24979]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:23.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:23 smithi190 bash[24979]: cluster 2024-09-06T15:18:21.918734+0000 mgr.y (mgr.14631) 206 : cluster [DBG] pgmap v139: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:25.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:25 smithi189 bash[22757]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:25 smithi189 bash[22757]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:25 smithi189 bash[29727]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:25 smithi189 bash[29727]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:25 smithi190 bash[24979]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:25 smithi190 bash[24979]: cluster 2024-09-06T15:18:23.919428+0000 mgr.y (mgr.14631) 207 : cluster [DBG] pgmap v140: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:25.921 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:27.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:27 smithi189 bash[22757]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:27.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:27 smithi189 bash[22757]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:27.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:27 smithi189 bash[29727]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:27.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:27 smithi189 bash[29727]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:27.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:27 smithi190 bash[24979]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:27.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:27 smithi190 bash[24979]: cluster 2024-09-06T15:18:25.920791+0000 mgr.y (mgr.14631) 208 : cluster [DBG] pgmap v141: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:29.597 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:29 smithi189 bash[22757]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:29.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:29 smithi189 bash[22757]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:29.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:29 smithi189 bash[29727]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:29.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:29 smithi189 bash[29727]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:29.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:29 smithi190 bash[24979]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:29.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:29 smithi190 bash[24979]: cluster 2024-09-06T15:18:27.921492+0000 mgr.y (mgr.14631) 209 : cluster [DBG] pgmap v142: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:30.729 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:31.339 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:31 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:31.597 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:31 smithi189 bash[29727]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:31 smithi189 bash[29727]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:31 smithi189 bash[22757]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:31 smithi189 bash[22757]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:31 smithi190 bash[24979]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:31 smithi190 bash[24979]: cluster 2024-09-06T15:18:29.922188+0000 mgr.y (mgr.14631) 210 : cluster [DBG] pgmap v143: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:31.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- 172.21.15.189:0/1411204482 >> v1:172.21.15.189:6790/0 conn(0x7faa381013d0 legacy=0x7faa381017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:31.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- 172.21.15.189:0/1411204482 shutdown_connections 2024-09-06T15:18:31.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- 172.21.15.189:0/1411204482 >> 172.21.15.189:0/1411204482 conn(0x7faa380fd240 msgr2=0x7faa380ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:31.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- 172.21.15.189:0/1411204482 shutdown_connections 2024-09-06T15:18:31.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- 172.21.15.189:0/1411204482 wait complete. 2024-09-06T15:18:31.900 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 Processor -- start 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- start start 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7faa381a98f0 con 0x7faa38101ec0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7faa381aaaf0 con 0x7faa38111230 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa3d0cb640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7faa381abcf0 con 0x7faa381013d0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa36d9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7faa381013d0 0x7faa38110a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:36888/0 (socket says 172.21.15.189:36888) 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.901+0000 7faa36d9d640 1 -- 172.21.15.189:0/2228806723 learned_addr learned my addr 172.21.15.189:0/2228806723 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228145009 0 0) 0x7faa381abcf0 con 0x7faa381013d0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa20003520 con 0x7faa381013d0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790206059 0 0) 0x7faa381a98f0 con 0x7faa38101ec0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa381abcf0 con 0x7faa38101ec0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2003525869 0 0) 0x7faa20003520 con 0x7faa381013d0 2024-09-06T15:18:31.901 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa381a98f0 con 0x7faa381013d0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7faa28001af0 con 0x7faa381013d0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3089701140 0 0) 0x7faa381abcf0 con 0x7faa38101ec0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa20003520 con 0x7faa38101ec0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7faa2c001840 con 0x7faa38101ec0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892557260 0 0) 0x7faa381aaaf0 con 0x7faa38111230 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa381abcf0 con 0x7faa38111230 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3951837982 0 0) 0x7faa381a98f0 con 0x7faa381013d0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 >> v1:172.21.15.190:6789/0 conn(0x7faa38111230 legacy=0x7faa381a7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 >> v1:172.21.15.189:6789/0 conn(0x7faa38101ec0 legacy=0x7faa381a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa381acf90 con 0x7faa381013d0 2024-09-06T15:18:31.902 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa381a9ac0 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faa381aa070 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7faa28001d20 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7faa28004da0 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa240050b0 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7faa28003800 con 0x7faa381013d0 2024-09-06T15:18:31.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.905+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7faa28094e70 con 0x7faa381013d0 2024-09-06T15:18:31.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:31.909+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7faa2805de50 con 0x7faa381013d0 2024-09-06T15:18:32.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.113+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa240053a0 con 0x7faa381013d0 2024-09-06T15:18:32.110 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.113+0000 7faa1ffff640 1 -- 172.21.15.189:0/2228806723 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7faa28061fc0 con 0x7faa381013d0 2024-09-06T15:18:32.111 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:32.111 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:32.112 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 >> v1:172.21.15.189:6800/1420554776 conn(0x7faa200783f0 legacy=0x7faa2007a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 >> v1:172.21.15.189:6790/0 conn(0x7faa381013d0 legacy=0x7faa38110a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 shutdown_connections 2024-09-06T15:18:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 >> 172.21.15.189:0/2228806723 conn(0x7faa380fd240 msgr2=0x7faa381146c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 shutdown_connections 2024-09-06T15:18:32.113 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:32.117+0000 7faa3d0cb640 1 -- 172.21.15.189:0/2228806723 wait complete. 2024-09-06T15:18:32.597 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[29727]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[29727]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[29727]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[29727]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[22757]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.598 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[22757]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[22757]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:32.599 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:32 smithi189 bash[22757]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:32 smithi190 bash[24979]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:32 smithi190 bash[24979]: audit 2024-09-06T15:18:31.041013+0000 mgr.y (mgr.14631) 211 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:32 smithi190 bash[24979]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:32.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:32 smithi190 bash[24979]: audit 2024-09-06T15:18:32.117304+0000 mon.c (mon.2) 116 : audit [DBG] from='client.? v1:172.21.15.189:0/2228806723' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:33 smithi190 bash[24979]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:33.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:33 smithi190 bash[24979]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:33.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:33 smithi189 bash[29727]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:33.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:33 smithi189 bash[29727]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:33.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:33 smithi189 bash[22757]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:33.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:33 smithi189 bash[22757]: cluster 2024-09-06T15:18:31.922929+0000 mgr.y (mgr.14631) 212 : cluster [DBG] pgmap v144: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:35.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:35 smithi190 bash[24979]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:35.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:35 smithi190 bash[24979]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:35.732 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:35.744 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:35 smithi189 bash[22757]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:35.744 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:35 smithi189 bash[22757]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:35.744 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:35 smithi189 bash[29727]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:35.745 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:35 smithi189 bash[29727]: cluster 2024-09-06T15:18:33.923538+0000 mgr.y (mgr.14631) 213 : cluster [DBG] pgmap v145: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:36.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:36 smithi190 bash[24979]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:36.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:36 smithi190 bash[24979]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:36.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:36 smithi189 bash[22757]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:36.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:36 smithi189 bash[22757]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:36.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:36 smithi189 bash[29727]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:36.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:36 smithi189 bash[29727]: audit 2024-09-06T15:18:35.658527+0000 mon.c (mon.2) 117 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:37.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:37 smithi190 bash[24979]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:37.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:37 smithi190 bash[24979]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:37.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:37 smithi189 bash[22757]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:37.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:37 smithi189 bash[22757]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:37.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:37 smithi189 bash[29727]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:37.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:37 smithi189 bash[29727]: cluster 2024-09-06T15:18:35.924963+0000 mgr.y (mgr.14631) 214 : cluster [DBG] pgmap v146: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:39.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:39 smithi190 bash[24979]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:39.620 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:39 smithi190 bash[24979]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:39.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:39 smithi189 bash[22757]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:39.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:39 smithi189 bash[22757]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:39.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:39 smithi189 bash[29727]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:39.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:39 smithi189 bash[29727]: cluster 2024-09-06T15:18:37.925625+0000 mgr.y (mgr.14631) 215 : cluster [DBG] pgmap v147: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:40.540 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:41.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:41 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/2164463596 >> v1:172.21.15.189:6790/0 conn(0x7f27b81028d0 legacy=0x7f27b8102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/2164463596 shutdown_connections 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/2164463596 >> 172.21.15.189:0/2164463596 conn(0x7f27b80fe360 msgr2=0x7f27b8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/2164463596 shutdown_connections 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/2164463596 wait complete. 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 Processor -- start 2024-09-06T15:18:41.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- start start 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27b81a74e0 con 0x7f27b810b440 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27b81a86e0 con 0x7f27b810efe0 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f27b81a98e0 con 0x7f27b81028d0 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27bcb44640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f27b81028d0 0x7f27b810e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:34624/0 (socket says 172.21.15.189:34624) 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27bcb44640 1 -- 172.21.15.189:0/1123867727 learned_addr learned my addr 172.21.15.189:0/1123867727 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b7fff640 1 --1- 172.21.15.189:0/1123867727 >> v1:172.21.15.189:6789/0 conn(0x7f27b810b440 0x7f27b81a2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:38444/0 (socket says 172.21.15.189:38444) 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675511235 0 0) 0x7f27b81a98e0 con 0x7f27b81028d0 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27b81028d0 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076638800 0 0) 0x7f27b81a74e0 con 0x7f27b810b440 2024-09-06T15:18:41.727 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b81a98e0 con 0x7f27b810b440 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1611391799 0 0) 0x7f27a4003520 con 0x7f27b81028d0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27b81a74e0 con 0x7f27b81028d0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f27a80015d0 con 0x7f27b81028d0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3652818314 0 0) 0x7f27b81a98e0 con 0x7f27b810b440 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27b810b440 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f27a0001210 con 0x7f27b810b440 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534783401 0 0) 0x7f27b81a86e0 con 0x7f27b810efe0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b81a98e0 con 0x7f27b810efe0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4236901904 0 0) 0x7f27b81a74e0 con 0x7f27b81028d0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 >> v1:172.21.15.190:6789/0 conn(0x7f27b810efe0 legacy=0x7f27b81a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 >> v1:172.21.15.189:6789/0 conn(0x7f27b810b440 legacy=0x7f27b81a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b81aab80 con 0x7f27b81028d0 2024-09-06T15:18:41.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27b81a9b10 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f27b81aa0f0 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f27a8001a20 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f27a8004ab0 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.729+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27980050b0 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.733+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f27a80035f0 con 0x7f27b81028d0 2024-09-06T15:18:41.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.733+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f27a8094d40 con 0x7f27b81028d0 2024-09-06T15:18:41.732 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.737+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f27a805dcc0 con 0x7f27b81028d0 2024-09-06T15:18:41.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:41 smithi189 bash[22757]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:41 smithi189 bash[22757]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:41 smithi189 bash[29727]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:41 smithi189 bash[29727]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:41 smithi190 bash[24979]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:41 smithi190 bash[24979]: cluster 2024-09-06T15:18:39.926325+0000 mgr.y (mgr.14631) 216 : cluster [DBG] pgmap v148: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:41.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.937+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f27980053a0 con 0x7f27b81028d0 2024-09-06T15:18:41.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.937+0000 7f27b5ffb640 1 -- 172.21.15.189:0/1123867727 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f27a8061e30 con 0x7f27b81028d0 2024-09-06T15:18:41.936 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:41.936 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:41.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 >> v1:172.21.15.189:6800/1420554776 conn(0x7f27a4078490 legacy=0x7f27a407a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:41.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 >> v1:172.21.15.189:6790/0 conn(0x7f27b81028d0 legacy=0x7f27b810e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:41.937 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 shutdown_connections 2024-09-06T15:18:41.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 >> 172.21.15.189:0/1123867727 conn(0x7f27b80fe360 msgr2=0x7f27b81081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:41.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 shutdown_connections 2024-09-06T15:18:41.938 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:41.941+0000 7f27beda8640 1 -- 172.21.15.189:0/1123867727 wait complete. 2024-09-06T15:18:42.347 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:42.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[22757]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[22757]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[22757]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[22757]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[29727]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[29727]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[29727]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:42.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:42 smithi189 bash[29727]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:42.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:42 smithi190 bash[24979]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:42 smithi190 bash[24979]: audit 2024-09-06T15:18:41.051014+0000 mgr.y (mgr.14631) 217 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:42.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:42 smithi190 bash[24979]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:42.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:42 smithi190 bash[24979]: audit 2024-09-06T15:18:41.942084+0000 mon.c (mon.2) 118 : audit [DBG] from='client.? v1:172.21.15.189:0/1123867727' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:43.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:43 smithi189 bash[29727]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:43.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:43 smithi189 bash[29727]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:43.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:43 smithi189 bash[22757]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:43.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:43 smithi189 bash[22757]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:43.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:43 smithi190 bash[24979]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:43.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:43 smithi190 bash[24979]: cluster 2024-09-06T15:18:41.927243+0000 mgr.y (mgr.14631) 218 : cluster [DBG] pgmap v149: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:45.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:45.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:45 smithi189 bash[22757]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:45.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:45 smithi189 bash[22757]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:45.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:45 smithi189 bash[29727]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:45.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:45 smithi189 bash[29727]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:45.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:45 smithi190 bash[24979]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:45.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:45 smithi190 bash[24979]: cluster 2024-09-06T15:18:43.927921+0000 mgr.y (mgr.14631) 219 : cluster [DBG] pgmap v150: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:47.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:47 smithi189 bash[29727]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:47.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:47 smithi189 bash[29727]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:47.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:47 smithi189 bash[22757]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:47.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:47 smithi189 bash[22757]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:47.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:47 smithi190 bash[24979]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:47.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:47 smithi190 bash[24979]: cluster 2024-09-06T15:18:45.929440+0000 mgr.y (mgr.14631) 220 : cluster [DBG] pgmap v151: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:49.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:49 smithi189 bash[29727]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:49.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:49 smithi189 bash[29727]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:49.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:49 smithi189 bash[22757]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:49.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:49 smithi189 bash[22757]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:49.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:49 smithi190 bash[24979]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:49.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:49 smithi190 bash[24979]: cluster 2024-09-06T15:18:47.930192+0000 mgr.y (mgr.14631) 221 : cluster [DBG] pgmap v152: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:50.365 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:18:51.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:18:51 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:18:51.546 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.545+0000 7fbb2a936640 1 -- 172.21.15.189:0/705234056 >> v1:172.21.15.189:6790/0 conn(0x7fbb2410efe0 legacy=0x7fbb241114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:51.547 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.545+0000 7fbb2a936640 1 -- 172.21.15.189:0/705234056 shutdown_connections 2024-09-06T15:18:51.547 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.545+0000 7fbb2a936640 1 -- 172.21.15.189:0/705234056 >> 172.21.15.189:0/705234056 conn(0x7fbb240fe360 msgr2=0x7fbb24100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:51.547 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.545+0000 7fbb2a936640 1 -- 172.21.15.189:0/705234056 shutdown_connections 2024-09-06T15:18:51.547 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.545+0000 7fbb2a936640 1 -- 172.21.15.189:0/705234056 wait complete. 2024-09-06T15:18:51.547 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 Processor -- start 2024-09-06T15:18:51.548 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- start start 2024-09-06T15:18:51.548 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb241a9700 con 0x7fbb241028d0 2024-09-06T15:18:51.548 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb241aa900 con 0x7fbb2410efe0 2024-09-06T15:18:51.548 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fbb241abb00 con 0x7fbb2410b440 2024-09-06T15:18:51.549 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb23fff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fbb241028d0 0x7fbb240769f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:45200/0 (socket says 172.21.15.189:45200) 2024-09-06T15:18:51.549 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb23fff640 1 -- 172.21.15.189:0/1182698457 learned_addr learned my addr 172.21.15.189:0/1182698457 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:18:51.549 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196513078 0 0) 0x7fbb241abb00 con 0x7fbb2410b440 2024-09-06T15:18:51.549 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb10003520 con 0x7fbb2410b440 2024-09-06T15:18:51.549 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106628882 0 0) 0x7fbb241a9700 con 0x7fbb241028d0 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb241abb00 con 0x7fbb241028d0 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3482179947 0 0) 0x7fbb10003520 con 0x7fbb2410b440 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb241a9700 con 0x7fbb2410b440 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1090464771 0 0) 0x7fbb241abb00 con 0x7fbb241028d0 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb10003520 con 0x7fbb241028d0 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb140018a0 con 0x7fbb2410b440 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb0c003fc0 con 0x7fbb241028d0 2024-09-06T15:18:51.550 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049213333 0 0) 0x7fbb241aa900 con 0x7fbb2410efe0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb241abb00 con 0x7fbb2410efe0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4045203358 0 0) 0x7fbb10003520 con 0x7fbb241028d0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 >> v1:172.21.15.189:6790/0 conn(0x7fbb2410b440 legacy=0x7fbb241a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 >> v1:172.21.15.190:6789/0 conn(0x7fbb2410efe0 legacy=0x7fbb241a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb241acda0 con 0x7fbb241028d0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb241a9930 con 0x7fbb241028d0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb241a9f60 con 0x7fbb241028d0 2024-09-06T15:18:51.551 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fbb0c001340 con 0x7fbb241028d0 2024-09-06T15:18:51.552 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fbb0c005b00 con 0x7fbb241028d0 2024-09-06T15:18:51.552 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb040050b0 con 0x7fbb241028d0 2024-09-06T15:18:51.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.549+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fbb0c000ed0 con 0x7fbb241028d0 2024-09-06T15:18:51.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.553+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fbb0c094b90 con 0x7fbb241028d0 2024-09-06T15:18:51.553 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.557+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fbb0c05db50 con 0x7fbb241028d0 2024-09-06T15:18:51.754 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.757+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb040053a0 con 0x7fbb241028d0 2024-09-06T15:18:51.755 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.757+0000 7fbb217fa640 1 -- 172.21.15.189:0/1182698457 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fbb0c061cc0 con 0x7fbb241028d0 2024-09-06T15:18:51.755 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:18:51.755 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 >> v1:172.21.15.189:6800/1420554776 conn(0x7fbb10078420 legacy=0x7fbb1007a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 >> v1:172.21.15.189:6789/0 conn(0x7fbb241028d0 legacy=0x7fbb240769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 shutdown_connections 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 >> 172.21.15.189:0/1182698457 conn(0x7fbb240fe360 msgr2=0x7fbb241060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 shutdown_connections 2024-09-06T15:18:51.757 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:18:51.761+0000 7fbb2a936640 1 -- 172.21.15.189:0/1182698457 wait complete. 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[29727]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[29727]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[29727]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[29727]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[22757]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[22757]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[22757]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:51.767 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:51 smithi189 bash[22757]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:51.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:51 smithi190 bash[24979]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:51 smithi190 bash[24979]: cluster 2024-09-06T15:18:49.930924+0000 mgr.y (mgr.14631) 222 : cluster [DBG] pgmap v153: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:51.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:51 smithi190 bash[24979]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:51.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:51 smithi190 bash[24979]: audit 2024-09-06T15:18:50.686095+0000 mon.c (mon.2) 119 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:18:52.530 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:18:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:18:52.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[22757]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[22757]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[22757]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[22757]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[29727]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[29727]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[29727]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:52.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:52 smithi189 bash[29727]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:52.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:52 smithi190 bash[24979]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:52 smithi190 bash[24979]: audit 2024-09-06T15:18:51.062074+0000 mgr.y (mgr.14631) 223 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:18:52.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:52 smithi190 bash[24979]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:52.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:52 smithi190 bash[24979]: audit 2024-09-06T15:18:51.761345+0000 mon.a (mon.0) 868 : audit [DBG] from='client.? v1:172.21.15.189:0/1182698457' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:18:53.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:53 smithi189 bash[22757]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:53.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:53 smithi189 bash[22757]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:53.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:53 smithi189 bash[29727]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:53.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:53 smithi189 bash[29727]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:53.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:53 smithi190 bash[24979]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:53.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:53 smithi190 bash[24979]: cluster 2024-09-06T15:18:51.932433+0000 mgr.y (mgr.14631) 224 : cluster [DBG] pgmap v154: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:55.409 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:18:55.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:55 smithi189 bash[22757]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:55.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:55 smithi189 bash[22757]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:55.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:55 smithi189 bash[29727]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:55.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:55 smithi189 bash[29727]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:55.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:55 smithi190 bash[24979]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:55.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:55 smithi190 bash[24979]: cluster 2024-09-06T15:18:53.933274+0000 mgr.y (mgr.14631) 225 : cluster [DBG] pgmap v155: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:57.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:57 smithi189 bash[22757]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:57.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:57 smithi189 bash[22757]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:57.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:57 smithi189 bash[29727]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:57.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:57 smithi189 bash[29727]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:57.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:57 smithi190 bash[24979]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:57.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:57 smithi190 bash[24979]: cluster 2024-09-06T15:18:55.934823+0000 mgr.y (mgr.14631) 226 : cluster [DBG] pgmap v156: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:18:59.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:59 smithi189 bash[22757]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:59.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:18:59 smithi189 bash[22757]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:59 smithi189 bash[29727]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:59.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:18:59 smithi189 bash[29727]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:59.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:59 smithi190 bash[24979]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:18:59.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:18:59 smithi190 bash[24979]: cluster 2024-09-06T15:18:57.935690+0000 mgr.y (mgr.14631) 227 : cluster [DBG] pgmap v157: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:00.219 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:01.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:01 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:01.383 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/2186132009 >> v1:172.21.15.189:6789/0 conn(0x7f41a010b430 legacy=0x7f41a010d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:01.383 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/2186132009 shutdown_connections 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/2186132009 >> 172.21.15.189:0/2186132009 conn(0x7f41a00fe330 msgr2=0x7f41a0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/2186132009 shutdown_connections 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/2186132009 wait complete. 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 Processor -- start 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- start start 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f41a01a74b0 con 0x7f41a010b430 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f41a01a86b0 con 0x7f41a01028c0 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f41a01a98b0 con 0x7f41a010efd0 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f419f7fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f41a010efd0 0x7f41a01a5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:52952/0 (socket says 172.21.15.189:52952) 2024-09-06T15:19:01.384 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f419f7fe640 1 -- 172.21.15.189:0/3719619979 learned_addr learned my addr 172.21.15.189:0/3719619979 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f419e7fc640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f41a010b430 0x7f41a01a2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:34052/0 (socket says 172.21.15.189:34052) 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528768613 0 0) 0x7f41a01a74b0 con 0x7f41a010b430 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4188001fe0 con 0x7f41a010b430 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496043718 0 0) 0x7f41a01a98b0 con 0x7f41a010efd0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a01a74b0 con 0x7f41a010efd0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014816157 0 0) 0x7f41a01a86b0 con 0x7f41a01028c0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a01a98b0 con 0x7f41a01028c0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2872991984 0 0) 0x7f4188001fe0 con 0x7f41a010b430 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41a01a86b0 con 0x7f41a010b430 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1014495242 0 0) 0x7f41a01a74b0 con 0x7f41a010efd0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4188001fe0 con 0x7f41a010efd0 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4194001650 con 0x7f41a010b430 2024-09-06T15:19:01.385 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4198001c50 con 0x7f41a010efd0 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 442226342 0 0) 0x7f41a01a86b0 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 >> v1:172.21.15.189:6790/0 conn(0x7f41a010efd0 legacy=0x7f41a01a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 >> v1:172.21.15.190:6789/0 conn(0x7f41a01028c0 legacy=0x7f41a010e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a01aab50 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01a9ae0 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41a01aa0c0 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f4194001150 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4194004c30 con 0x7f41a010b430 2024-09-06T15:19:01.386 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.385+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c0050b0 con 0x7f41a010b430 2024-09-06T15:19:01.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.389+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f4194004dd0 con 0x7f41a010b430 2024-09-06T15:19:01.387 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.389+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f4194094ba0 con 0x7f41a010b430 2024-09-06T15:19:01.388 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.393+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f419405db20 con 0x7f41a010b430 2024-09-06T15:19:01.596 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f418c0053a0 con 0x7f41a010b430 2024-09-06T15:19:01.596 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f4187fff640 1 -- 172.21.15.189:0/3719619979 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f4194061c90 con 0x7f41a010b430 2024-09-06T15:19:01.597 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:01.597 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 >> v1:172.21.15.189:6800/1420554776 conn(0x7f41880783e0 legacy=0x7f418807a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 >> v1:172.21.15.189:6789/0 conn(0x7f41a010b430 legacy=0x7f41a01a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 shutdown_connections 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 >> 172.21.15.189:0/3719619979 conn(0x7f41a00fe330 msgr2=0x7f41a01060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 shutdown_connections 2024-09-06T15:19:01.599 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:01.601+0000 7f41a55d4640 1 -- 172.21.15.189:0/3719619979 wait complete. 2024-09-06T15:19:01.800 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:01 smithi189 bash[22757]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:01.800 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:01 smithi189 bash[22757]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:01.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:01 smithi189 bash[29727]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:01.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:01 smithi189 bash[29727]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:01.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:01 smithi190 bash[24979]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:01.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:01 smithi190 bash[24979]: cluster 2024-09-06T15:18:59.936552+0000 mgr.y (mgr.14631) 228 : cluster [DBG] pgmap v158: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:02.549 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[22757]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[22757]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[22757]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:02.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[22757]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:02.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[29727]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[29727]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[29727]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:02.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:02 smithi189 bash[29727]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:02.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:02 smithi190 bash[24979]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:02 smithi190 bash[24979]: audit 2024-09-06T15:19:01.073438+0000 mgr.y (mgr.14631) 229 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:02.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:02 smithi190 bash[24979]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:02.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:02 smithi190 bash[24979]: audit 2024-09-06T15:19:01.603361+0000 mon.a (mon.0) 869 : audit [DBG] from='client.? v1:172.21.15.189:0/3719619979' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:03.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:03 smithi189 bash[22757]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:03.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:03 smithi189 bash[22757]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:03.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:03 smithi189 bash[29727]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:03.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:03 smithi189 bash[29727]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:03.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:03 smithi190 bash[24979]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:03.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:03 smithi190 bash[24979]: cluster 2024-09-06T15:19:01.938112+0000 mgr.y (mgr.14631) 230 : cluster [DBG] pgmap v159: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:05.225 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:05.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:05 smithi189 bash[22757]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:05.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:05 smithi189 bash[22757]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:05.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:05 smithi189 bash[29727]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:05.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:05 smithi189 bash[29727]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:05.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:05 smithi190 bash[24979]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:05.873 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:05 smithi190 bash[24979]: cluster 2024-09-06T15:19:03.938868+0000 mgr.y (mgr.14631) 231 : cluster [DBG] pgmap v160: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:06.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:06 smithi189 bash[22757]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:06.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:06 smithi189 bash[22757]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:06.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:06 smithi189 bash[29727]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:06.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:06 smithi189 bash[29727]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:06.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:06 smithi190 bash[24979]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:06.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:06 smithi190 bash[24979]: audit 2024-09-06T15:19:05.713837+0000 mon.c (mon.2) 120 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:07.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:07 smithi189 bash[22757]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:07.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:07 smithi189 bash[22757]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:07.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:07 smithi189 bash[29727]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:07.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:07 smithi189 bash[29727]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:07.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:07 smithi190 bash[24979]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:07.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:07 smithi190 bash[24979]: cluster 2024-09-06T15:19:05.940313+0000 mgr.y (mgr.14631) 232 : cluster [DBG] pgmap v161: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:09.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:09 smithi189 bash[22757]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:09.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:09 smithi189 bash[22757]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:09.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:09 smithi189 bash[29727]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:09.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:09 smithi189 bash[29727]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:09.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:09 smithi190 bash[24979]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:09.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:09 smithi190 bash[24979]: cluster 2024-09-06T15:19:07.941039+0000 mgr.y (mgr.14631) 233 : cluster [DBG] pgmap v162: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:10.031 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:11.213 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/3319238713 >> v1:172.21.15.189:6789/0 conn(0x7f4ea410d640 legacy=0x7f4ea410fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:11.213 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/3319238713 shutdown_connections 2024-09-06T15:19:11.213 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/3319238713 >> 172.21.15.189:0/3319238713 conn(0x7f4ea4100520 msgr2=0x7f4ea4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:11.213 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/3319238713 shutdown_connections 2024-09-06T15:19:11.214 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/3319238713 wait complete. 2024-09-06T15:19:11.214 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 Processor -- start 2024-09-06T15:19:11.214 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- start start 2024-09-06T15:19:11.215 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4ea41a9930 con 0x7f4ea410d640 2024-09-06T15:19:11.215 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4ea41aab30 con 0x7f4ea4104ad0 2024-09-06T15:19:11.215 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f4ea41abd30 con 0x7f4ea41111e0 2024-09-06T15:19:11.215 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4e9bfff640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f4ea410d640 0x7f4ea41a4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:41316/0 (socket says 172.21.15.189:41316) 2024-09-06T15:19:11.215 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4e9bfff640 1 -- 172.21.15.189:0/4009209993 learned_addr learned my addr 172.21.15.189:0/4009209993 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660394811 0 0) 0x7f4ea41a9930 con 0x7f4ea410d640 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e90003520 con 0x7f4ea410d640 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181729115 0 0) 0x7f4ea41abd30 con 0x7f4ea41111e0 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea41a9930 con 0x7f4ea41111e0 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4164505770 0 0) 0x7f4e90003520 con 0x7f4ea410d640 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ea41abd30 con 0x7f4ea410d640 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4e8c001af0 con 0x7f4ea410d640 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2385077375 0 0) 0x7f4ea41a9930 con 0x7f4ea41111e0 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e90003520 con 0x7f4ea41111e0 2024-09-06T15:19:11.216 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886616893 0 0) 0x7f4ea41aab30 con 0x7f4ea4104ad0 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea41a9930 con 0x7f4ea4104ad0 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4e9c001b60 con 0x7f4ea41111e0 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 601014463 0 0) 0x7f4ea41abd30 con 0x7f4ea410d640 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 >> v1:172.21.15.189:6790/0 conn(0x7f4ea41111e0 legacy=0x7f4ea41a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 >> v1:172.21.15.190:6789/0 conn(0x7f4ea4104ad0 legacy=0x7f4ea4110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea41acfd0 con 0x7f4ea410d640 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea41abf60 con 0x7f4ea410d640 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ea41ac510 con 0x7f4ea410d640 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f4e8c001d20 con 0x7f4ea410d640 2024-09-06T15:19:11.217 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.216+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f4e8c004cb0 con 0x7f4ea410d640 2024-09-06T15:19:11.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.220+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e84005080 con 0x7f4ea410d640 2024-09-06T15:19:11.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.220+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f4e8c004020 con 0x7f4ea410d640 2024-09-06T15:19:11.218 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.220+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f4e8c094e80 con 0x7f4ea410d640 2024-09-06T15:19:11.221 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.224+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f4e8c05de00 con 0x7f4ea410d640 2024-09-06T15:19:11.370 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:11 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:11.422 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.424+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e84005370 con 0x7f4ea410d640 2024-09-06T15:19:11.423 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.424+0000 7f4ea17fa640 1 -- 172.21.15.189:0/4009209993 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f4e8c061f70 con 0x7f4ea410d640 2024-09-06T15:19:11.423 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:11.423 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 >> v1:172.21.15.189:6800/1420554776 conn(0x7f4e90078350 legacy=0x7f4e9007a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 >> v1:172.21.15.189:6789/0 conn(0x7f4ea410d640 legacy=0x7f4ea41a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 shutdown_connections 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 >> 172.21.15.189:0/4009209993 conn(0x7f4ea4100520 msgr2=0x7f4ea4113e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 shutdown_connections 2024-09-06T15:19:11.425 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:11.428+0000 7f4eaa020640 1 -- 172.21.15.189:0/4009209993 wait complete. 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[22757]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[22757]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[22757]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[22757]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[29727]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[29727]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[29727]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:11.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:11 smithi189 bash[29727]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:11.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:11 smithi190 bash[24979]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:11 smithi190 bash[24979]: cluster 2024-09-06T15:19:09.941692+0000 mgr.y (mgr.14631) 234 : cluster [DBG] pgmap v163: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:11.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:11 smithi190 bash[24979]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:11.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:11 smithi190 bash[24979]: audit 2024-09-06T15:19:11.430015+0000 mon.a (mon.0) 870 : audit [DBG] from='client.? v1:172.21.15.189:0/4009209993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:12.347 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:12.847 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:12 smithi189 bash[29727]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:12.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:12 smithi189 bash[29727]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:12.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:12 smithi189 bash[22757]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:12.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:12 smithi189 bash[22757]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:12.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:12 smithi190 bash[24979]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:12.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:12 smithi190 bash[24979]: audit 2024-09-06T15:19:11.084828+0000 mgr.y (mgr.14631) 235 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:13.847 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:13 smithi189 bash[22757]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:13.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:13 smithi189 bash[22757]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:13.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:13 smithi189 bash[29727]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:13.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:13 smithi189 bash[29727]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:13.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:13 smithi190 bash[24979]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:13.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:13 smithi190 bash[24979]: cluster 2024-09-06T15:19:11.943226+0000 mgr.y (mgr.14631) 236 : cluster [DBG] pgmap v164: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:15.062 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:15.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:15 smithi190 bash[24979]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:15.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:15 smithi190 bash[24979]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:16.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:15 smithi189 bash[22757]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:16.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:15 smithi189 bash[22757]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:16.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:15 smithi189 bash[29727]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:16.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:15 smithi189 bash[29727]: cluster 2024-09-06T15:19:13.943938+0000 mgr.y (mgr.14631) 237 : cluster [DBG] pgmap v165: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:17.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:17 smithi190 bash[24979]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:17.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:17 smithi190 bash[24979]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:17.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:17 smithi190 bash[24979]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:17.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:17 smithi190 bash[24979]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:18.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[29727]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:18.097 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[29727]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[29727]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[29727]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[22757]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[22757]: cluster 2024-09-06T15:19:15.945351+0000 mgr.y (mgr.14631) 238 : cluster [DBG] pgmap v166: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[22757]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:17 smithi189 bash[22757]: audit 2024-09-06T15:19:17.559040+0000 mon.c (mon.2) 121 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:19:18.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:18.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:18.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:18.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:18.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:18.870 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:18 smithi190 bash[24979]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[22757]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.343767+0000 mon.c (mon.2) 122 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.344720+0000 mon.c (mon.2) 123 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:18 smithi189 bash[29727]: audit 2024-09-06T15:19:18.354791+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:19:19.862 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:19.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:19 smithi190 bash[24979]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:19.869 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:19 smithi190 bash[24979]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:19.961 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:19 smithi189 bash[22757]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:19.961 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:19 smithi189 bash[22757]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:19.961 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:19 smithi189 bash[29727]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:19.961 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:19 smithi189 bash[29727]: cluster 2024-09-06T15:19:17.945863+0000 mgr.y (mgr.14631) 239 : cluster [DBG] pgmap v167: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:21.176 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2038734329 >> v1:172.21.15.189:6790/0 conn(0x7ffa7c10b430 legacy=0x7ffa7c10d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:21.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2038734329 shutdown_connections 2024-09-06T15:19:21.177 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2038734329 >> 172.21.15.189:0/2038734329 conn(0x7ffa7c0fe330 msgr2=0x7ffa7c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:21.178 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2038734329 shutdown_connections 2024-09-06T15:19:21.178 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2038734329 wait complete. 2024-09-06T15:19:21.178 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 Processor -- start 2024-09-06T15:19:21.178 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- start start 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa7c10c5e0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa7c1a8550 con 0x7ffa7c1028c0 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7ffa7c1a9730 con 0x7ffa7c10b430 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa81dc5640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7ffa7c10efd0 0x7ffa7c1a5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56006/0 (socket says 172.21.15.189:56006) 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa81dc5640 1 -- 172.21.15.189:0/2100382142 learned_addr learned my addr 172.21.15.189:0/2100382142 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa80dc3640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7ffa7c10b430 0x7ffa7c1a26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:39784/0 (socket says 172.21.15.189:39784) 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38774659 0 0) 0x7ffa7c10c5e0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa68003520 con 0x7ffa7c10efd0 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184609320 0 0) 0x7ffa7c1a9730 con 0x7ffa7c10b430 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa7c10c5e0 con 0x7ffa7c10b430 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2903359822 0 0) 0x7ffa68003520 con 0x7ffa7c10efd0 2024-09-06T15:19:21.179 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa7c1a9730 con 0x7ffa7c10efd0 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ffa74001c90 con 0x7ffa7c10efd0 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2693545465 0 0) 0x7ffa7c10c5e0 con 0x7ffa7c10b430 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa68003520 con 0x7ffa7c10b430 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ffa6c0015d0 con 0x7ffa7c10b430 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2742088710 0 0) 0x7ffa7c1a8550 con 0x7ffa7c1028c0 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa7c10c5e0 con 0x7ffa7c1028c0 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4153556640 0 0) 0x7ffa7c1a9730 con 0x7ffa7c10efd0 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 >> v1:172.21.15.189:6790/0 conn(0x7ffa7c10b430 legacy=0x7ffa7c1a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 >> v1:172.21.15.190:6789/0 conn(0x7ffa7c1028c0 legacy=0x7ffa7c10b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:21.180 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c1aa9b0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c1a9960 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa7c1a9f90 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7ffa74003de0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.180+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7ffa74005ef0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.184+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa600050b0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.184+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7ffa74003970 con 0x7ffa7c10efd0 2024-09-06T15:19:21.181 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.184+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7ffa74094ff0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.184 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.188+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7ffa7405df70 con 0x7ffa7c10efd0 2024-09-06T15:19:21.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:21.389 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.392+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa600053a0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.390 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.392+0000 7ffa727fc640 1 -- 172.21.15.189:0/2100382142 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7ffa740620e0 con 0x7ffa7c10efd0 2024-09-06T15:19:21.390 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:21.390 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:21.392 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 >> v1:172.21.15.189:6800/1420554776 conn(0x7ffa68078440 legacy=0x7ffa6807a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:21.392 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 >> v1:172.21.15.189:6789/0 conn(0x7ffa7c10efd0 legacy=0x7ffa7c1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:21.393 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 shutdown_connections 2024-09-06T15:19:21.393 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 >> 172.21.15.189:0/2100382142 conn(0x7ffa7c0fe330 msgr2=0x7ffa7c111c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:21.393 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 shutdown_connections 2024-09-06T15:19:21.393 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:21.396+0000 7ffa83828640 1 -- 172.21.15.189:0/2100382142 wait complete. 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:21.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[29727]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:21 smithi189 bash[22757]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:22.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:22.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: cluster 2024-09-06T15:19:19.946734+0000 mgr.y (mgr.14631) 240 : cluster [DBG] pgmap v168: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:22.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:22.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: audit 2024-09-06T15:19:20.742138+0000 mon.c (mon.2) 124 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:22.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:22.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:21 smithi190 bash[24979]: audit 2024-09-06T15:19:21.396585+0000 mon.a (mon.0) 872 : audit [DBG] from='client.? v1:172.21.15.189:0/2100382142' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:22.347 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:23.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:22 smithi189 bash[22757]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:23.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:22 smithi189 bash[22757]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:23.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:22 smithi189 bash[29727]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:23.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:22 smithi189 bash[29727]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:23.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:22 smithi190 bash[24979]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:23.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:22 smithi190 bash[24979]: audit 2024-09-06T15:19:21.092295+0000 mgr.y (mgr.14631) 241 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:24.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:23 smithi189 bash[22757]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:24.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:23 smithi189 bash[22757]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:24.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:23 smithi189 bash[29727]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:24.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:23 smithi189 bash[29727]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:24.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:23 smithi190 bash[24979]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:24.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:23 smithi190 bash[24979]: cluster 2024-09-06T15:19:21.948220+0000 mgr.y (mgr.14631) 242 : cluster [DBG] pgmap v169: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:25.018 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:26.097 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:25 smithi189 bash[22757]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:26.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:25 smithi189 bash[22757]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:26.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:25 smithi189 bash[29727]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:26.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:25 smithi189 bash[29727]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:26.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:25 smithi190 bash[24979]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:26.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:25 smithi190 bash[24979]: cluster 2024-09-06T15:19:23.948927+0000 mgr.y (mgr.14631) 243 : cluster [DBG] pgmap v170: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:28.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:27 smithi189 bash[22757]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:28.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:27 smithi189 bash[22757]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:28.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:27 smithi189 bash[29727]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:28.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:27 smithi189 bash[29727]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:28.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:27 smithi190 bash[24979]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:28.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:27 smithi190 bash[24979]: cluster 2024-09-06T15:19:25.950348+0000 mgr.y (mgr.14631) 244 : cluster [DBG] pgmap v171: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:29.817 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:29.917 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:29 smithi189 bash[22757]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:29.917 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:29 smithi189 bash[22757]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:29.917 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:29 smithi189 bash[29727]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:29.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:29 smithi189 bash[29727]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:30.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:29 smithi190 bash[24979]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:30.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:29 smithi190 bash[24979]: cluster 2024-09-06T15:19:27.951077+0000 mgr.y (mgr.14631) 245 : cluster [DBG] pgmap v172: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:30.973 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/1870091271 >> v1:172.21.15.189:6790/0 conn(0x7fe2341028d0 legacy=0x7fe234102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:30.973 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/1870091271 shutdown_connections 2024-09-06T15:19:30.973 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/1870091271 >> 172.21.15.189:0/1870091271 conn(0x7fe2340fe360 msgr2=0x7fe234100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:30.973 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/1870091271 shutdown_connections 2024-09-06T15:19:30.973 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/1870091271 wait complete. 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 Processor -- start 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- start start 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2341a74e0 con 0x7fe23410efe0 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2341a86e0 con 0x7fe23410b440 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fe2341a98e0 con 0x7fe2341028d0 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe232ffd640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fe2341028d0 0x7fe23410e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:40272/0 (socket says 172.21.15.189:40272) 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe232ffd640 1 -- 172.21.15.189:0/147826210 learned_addr learned my addr 172.21.15.189:0/147826210 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:30.975 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711919322 0 0) 0x7fe2341a98e0 con 0x7fe2341028d0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c003160 con 0x7fe2341028d0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526686686 0 0) 0x7fe2341a74e0 con 0x7fe23410efe0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2341a98e0 con 0x7fe23410efe0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3841664728 0 0) 0x7fe21c003160 con 0x7fe2341028d0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2341a74e0 con 0x7fe2341028d0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe224001410 con 0x7fe2341028d0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700509243 0 0) 0x7fe2341a86e0 con 0x7fe23410b440 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c003160 con 0x7fe23410b440 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2087074247 0 0) 0x7fe2341a98e0 con 0x7fe23410efe0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2341a86e0 con 0x7fe23410efe0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe22c001bb0 con 0x7fe23410efe0 2024-09-06T15:19:30.976 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 893406583 0 0) 0x7fe2341a74e0 con 0x7fe2341028d0 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 >> v1:172.21.15.190:6789/0 conn(0x7fe23410b440 legacy=0x7fe2341a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 >> v1:172.21.15.189:6789/0 conn(0x7fe23410efe0 legacy=0x7fe2341a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341aab80 con 0x7fe2341028d0 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a7710 con 0x7fe2341028d0 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2341a7c70 con 0x7fe2341028d0 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fe2240038a0 con 0x7fe2341028d0 2024-09-06T15:19:30.977 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fe224004ca0 con 0x7fe2341028d0 2024-09-06T15:19:30.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.976+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2200050b0 con 0x7fe2341028d0 2024-09-06T15:19:30.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.980+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fe2240018e0 con 0x7fe2341028d0 2024-09-06T15:19:30.978 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.980+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fe224094f70 con 0x7fe2341028d0 2024-09-06T15:19:30.980 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:30.984+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fe22405def0 con 0x7fe2341028d0 2024-09-06T15:19:31.188 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.188+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe2200053a0 con 0x7fe2341028d0 2024-09-06T15:19:31.188 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe21bfff640 1 -- 172.21.15.189:0/147826210 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fe224062060 con 0x7fe2341028d0 2024-09-06T15:19:31.188 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:31.189 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 >> v1:172.21.15.189:6800/1420554776 conn(0x7fe21c078410 legacy=0x7fe21c07a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 >> v1:172.21.15.189:6790/0 conn(0x7fe2341028d0 legacy=0x7fe23410e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 shutdown_connections 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 >> 172.21.15.189:0/147826210 conn(0x7fe2340fe360 msgr2=0x7fe2341081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 shutdown_connections 2024-09-06T15:19:31.191 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:31.192+0000 7fe23961f640 1 -- 172.21.15.189:0/147826210 wait complete. 2024-09-06T15:19:31.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:31 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:32.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[22757]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[22757]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[22757]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[22757]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[29727]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[29727]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[29727]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:31 smithi189 bash[29727]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:31 smithi190 bash[24979]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:31 smithi190 bash[24979]: cluster 2024-09-06T15:19:29.951843+0000 mgr.y (mgr.14631) 246 : cluster [DBG] pgmap v173: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:32.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:31 smithi190 bash[24979]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:31 smithi190 bash[24979]: audit 2024-09-06T15:19:31.194783+0000 mon.c (mon.2) 125 : audit [DBG] from='client.? v1:172.21.15.189:0/147826210' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:32.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:32 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:33.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:32 smithi189 bash[22757]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:33.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:32 smithi189 bash[22757]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:33.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:32 smithi189 bash[29727]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:33.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:32 smithi189 bash[29727]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:33.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:32 smithi190 bash[24979]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:33.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:32 smithi190 bash[24979]: audit 2024-09-06T15:19:31.103459+0000 mgr.y (mgr.14631) 247 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:33 smithi189 bash[22757]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:33 smithi189 bash[22757]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:33 smithi189 bash[29727]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:33 smithi189 bash[29727]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:33 smithi190 bash[24979]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:33 smithi190 bash[24979]: cluster 2024-09-06T15:19:31.953382+0000 mgr.y (mgr.14631) 248 : cluster [DBG] pgmap v174: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:34.811 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:36.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:35 smithi189 bash[22757]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:36.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:35 smithi189 bash[22757]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:36.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:35 smithi189 bash[29727]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:36.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:35 smithi189 bash[29727]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:36.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:35 smithi190 bash[24979]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:36.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:35 smithi190 bash[24979]: cluster 2024-09-06T15:19:33.954224+0000 mgr.y (mgr.14631) 249 : cluster [DBG] pgmap v175: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:37.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:36 smithi189 bash[22757]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:37.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:36 smithi189 bash[22757]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:36 smithi189 bash[29727]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:37.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:36 smithi189 bash[29727]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:37.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:36 smithi190 bash[24979]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:37.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:36 smithi190 bash[24979]: audit 2024-09-06T15:19:35.769332+0000 mon.c (mon.2) 126 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:38.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:37 smithi189 bash[22757]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:38.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:37 smithi189 bash[22757]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:38.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:37 smithi189 bash[29727]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:38.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:37 smithi189 bash[29727]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:38.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:37 smithi190 bash[24979]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:38.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:37 smithi190 bash[24979]: cluster 2024-09-06T15:19:35.955841+0000 mgr.y (mgr.14631) 250 : cluster [DBG] pgmap v176: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:39.614 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:40.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:39 smithi189 bash[22757]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:39 smithi189 bash[22757]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:39 smithi189 bash[29727]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:39 smithi189 bash[29727]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:39 smithi190 bash[24979]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:39 smithi190 bash[24979]: cluster 2024-09-06T15:19:37.956559+0000 mgr.y (mgr.14631) 251 : cluster [DBG] pgmap v177: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:40.773 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/846095861 >> v1:172.21.15.189:6790/0 conn(0x7f121810b600 legacy=0x7f121810d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:40.773 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/846095861 shutdown_connections 2024-09-06T15:19:40.773 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/846095861 >> 172.21.15.189:0/846095861 conn(0x7f12180fd230 msgr2=0x7f12180ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:40.773 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/846095861 shutdown_connections 2024-09-06T15:19:40.773 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/846095861 wait complete. 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 Processor -- start 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- start start 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f121810eaa0 con 0x7f12181037f0 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f12181aaa10 con 0x7f121810b600 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f12181abbf0 con 0x7f121810f110 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f1216d9d640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f12181037f0 0x7f121810de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:34262/0 (socket says 172.21.15.189:34262) 2024-09-06T15:19:40.774 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f1216d9d640 1 -- 172.21.15.189:0/2989239432 learned_addr learned my addr 172.21.15.189:0/2989239432 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:40.775 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913358111 0 0) 0x7f12181abbf0 con 0x7f121810f110 2024-09-06T15:19:40.775 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1200003520 con 0x7f121810f110 2024-09-06T15:19:40.775 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717655636 0 0) 0x7f121810eaa0 con 0x7f12181037f0 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12181abbf0 con 0x7f12181037f0 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3202516242 0 0) 0x7f1200003520 con 0x7f121810f110 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f121810eaa0 con 0x7f121810f110 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1890423961 0 0) 0x7f12181abbf0 con 0x7f12181037f0 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1200003520 con 0x7f12181037f0 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917158674 0 0) 0x7f12181aaa10 con 0x7f121810b600 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12181abbf0 con 0x7f121810b600 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1210001580 con 0x7f121810f110 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1208001970 con 0x7f12181037f0 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1813351158 0 0) 0x7f121810eaa0 con 0x7f121810f110 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 >> v1:172.21.15.190:6789/0 conn(0x7f121810b600 legacy=0x7f12181a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:40.776 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 >> v1:172.21.15.189:6789/0 conn(0x7f12181037f0 legacy=0x7f121810de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12181aceb0 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12181abe20 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f12181ac450 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1210003de0 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1210004c40 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.775+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12040050b0 con 0x7f121810f110 2024-09-06T15:19:40.777 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.779+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f12100045c0 con 0x7f121810f110 2024-09-06T15:19:40.778 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.779+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f1210093ce0 con 0x7f121810f110 2024-09-06T15:19:40.780 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.783+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f121005cc60 con 0x7f121810f110 2024-09-06T15:19:40.983 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.983+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f12040053a0 con 0x7f121810f110 2024-09-06T15:19:40.984 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f11fffff640 1 -- 172.21.15.189:0/2989239432 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f1210060dd0 con 0x7f121810f110 2024-09-06T15:19:40.984 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:40.985 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:40.986 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 >> v1:172.21.15.189:6800/1420554776 conn(0x7f1200078490 legacy=0x7f120007a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:40.986 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 >> v1:172.21.15.189:6790/0 conn(0x7f121810f110 legacy=0x7f12181a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:40.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 shutdown_connections 2024-09-06T15:19:40.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 >> 172.21.15.189:0/2989239432 conn(0x7f12180fd230 msgr2=0x7f1218111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:40.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 shutdown_connections 2024-09-06T15:19:40.987 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:40.987+0000 7f121d219640 1 -- 172.21.15.189:0/2989239432 wait complete. 2024-09-06T15:19:41.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:41 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:42.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[22757]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[22757]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[22757]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[22757]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[29727]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[29727]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[29727]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:41 smithi189 bash[29727]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:41 smithi190 bash[24979]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:41 smithi190 bash[24979]: cluster 2024-09-06T15:19:39.957262+0000 mgr.y (mgr.14631) 252 : cluster [DBG] pgmap v178: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:42.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:41 smithi190 bash[24979]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:41 smithi190 bash[24979]: audit 2024-09-06T15:19:40.990713+0000 mon.c (mon.2) 127 : audit [DBG] from='client.? v1:172.21.15.189:0/2989239432' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:42.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:42 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:43.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:42 smithi189 bash[22757]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:43.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:42 smithi189 bash[22757]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:43.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:42 smithi189 bash[29727]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:43.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:42 smithi189 bash[29727]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:43.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:42 smithi190 bash[24979]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:43.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:42 smithi190 bash[24979]: audit 2024-09-06T15:19:41.114670+0000 mgr.y (mgr.14631) 253 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:44.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:43 smithi189 bash[22757]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:43 smithi189 bash[22757]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:43 smithi189 bash[29727]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:43 smithi189 bash[29727]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:43 smithi190 bash[24979]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:43 smithi190 bash[24979]: cluster 2024-09-06T15:19:41.958792+0000 mgr.y (mgr.14631) 254 : cluster [DBG] pgmap v179: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:44.612 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:46.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:45 smithi189 bash[22757]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:46.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:45 smithi189 bash[22757]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:46.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:45 smithi189 bash[29727]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:46.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:45 smithi189 bash[29727]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:46.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:45 smithi190 bash[24979]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:46.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:45 smithi190 bash[24979]: cluster 2024-09-06T15:19:43.959526+0000 mgr.y (mgr.14631) 255 : cluster [DBG] pgmap v180: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:48.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:47 smithi189 bash[22757]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:48.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:47 smithi189 bash[22757]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:48.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:47 smithi189 bash[29727]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:48.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:47 smithi189 bash[29727]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:48.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:47 smithi190 bash[24979]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:48.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:47 smithi190 bash[24979]: cluster 2024-09-06T15:19:45.961001+0000 mgr.y (mgr.14631) 256 : cluster [DBG] pgmap v181: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:49.418 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:19:49.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:49 smithi189 bash[22757]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:49.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:49 smithi189 bash[22757]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:49.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:49 smithi189 bash[29727]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:49.848 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:49 smithi189 bash[29727]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:50.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:49 smithi190 bash[24979]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:50.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:49 smithi190 bash[24979]: cluster 2024-09-06T15:19:47.961766+0000 mgr.y (mgr.14631) 257 : cluster [DBG] pgmap v182: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.695+0000 7f0d40f1c640 1 -- 172.21.15.189:0/2709253907 >> v1:172.21.15.189:6790/0 conn(0x7f0d3c1028d0 legacy=0x7f0d3c102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.695+0000 7f0d40f1c640 1 -- 172.21.15.189:0/2709253907 shutdown_connections 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.695+0000 7f0d40f1c640 1 -- 172.21.15.189:0/2709253907 >> 172.21.15.189:0/2709253907 conn(0x7f0d3c0fe360 msgr2=0x7f0d3c100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.695+0000 7f0d40f1c640 1 -- 172.21.15.189:0/2709253907 shutdown_connections 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.695+0000 7f0d40f1c640 1 -- 172.21.15.189:0/2709253907 wait complete. 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 Processor -- start 2024-09-06T15:19:50.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- start start 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0d3c1a9830 con 0x7f0d3c10b440 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0d3c1aaa30 con 0x7f0d3c1028d0 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f0d3c1abc30 con 0x7f0d3c10efe0 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d3ad9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f0d3c10efe0 0x7f0d3c1a7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:52954/0 (socket says 172.21.15.189:52954) 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d3ad9d640 1 -- 172.21.15.189:0/562737374 learned_addr learned my addr 172.21.15.189:0/562737374 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118095793 0 0) 0x7f0d3c1abc30 con 0x7f0d3c10efe0 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003520 con 0x7f0d3c10efe0 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142489961 0 0) 0x7f0d3c1a9830 con 0x7f0d3c10b440 2024-09-06T15:19:50.698 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d3c1abc30 con 0x7f0d3c10b440 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 973399639 0 0) 0x7f0d24003520 con 0x7f0d3c10efe0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d3c1a9830 con 0x7f0d3c10efe0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0d34001d30 con 0x7f0d3c10efe0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 109109327 0 0) 0x7f0d3c1aaa30 con 0x7f0d3c1028d0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003520 con 0x7f0d3c1028d0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3185398345 0 0) 0x7f0d3c1abc30 con 0x7f0d3c10b440 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d3c1aaa30 con 0x7f0d3c10b440 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0d2c0018b0 con 0x7f0d3c10b440 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1022697735 0 0) 0x7f0d3c1a9830 con 0x7f0d3c10efe0 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 >> v1:172.21.15.190:6789/0 conn(0x7f0d3c1028d0 legacy=0x7f0d3c0768d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 >> v1:172.21.15.189:6789/0 conn(0x7f0d3c10b440 legacy=0x7f0d3c1a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:50.699 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d3c1aced0 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d3c1a9a60 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d3c1aa090 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f0d34003e00 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f0d34005fa0 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1c0050b0 con 0x7f0d3c10efe0 2024-09-06T15:19:50.700 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.699+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f0d34003970 con 0x7f0d3c10efe0 2024-09-06T15:19:50.701 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.703+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f0d34095080 con 0x7f0d3c10efe0 2024-09-06T15:19:50.703 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.703+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f0d3405e000 con 0x7f0d3c10efe0 2024-09-06T15:19:50.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.903+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d1c0053a0 con 0x7f0d3c10efe0 2024-09-06T15:19:50.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.903+0000 7f0d2b7fe640 1 -- 172.21.15.189:0/562737374 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f0d34062170 con 0x7f0d3c10efe0 2024-09-06T15:19:50.903 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:19:50.903 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:19:50.905 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 >> v1:172.21.15.189:6800/1420554776 conn(0x7f0d24078480 legacy=0x7f0d2407a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:50.905 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 >> v1:172.21.15.189:6790/0 conn(0x7f0d3c10efe0 legacy=0x7f0d3c1a7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:19:50.905 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 shutdown_connections 2024-09-06T15:19:50.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 >> 172.21.15.189:0/562737374 conn(0x7f0d3c0fe360 msgr2=0x7f0d3c100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:19:50.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 shutdown_connections 2024-09-06T15:19:50.906 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:19:50.907+0000 7f0d40f1c640 1 -- 172.21.15.189:0/562737374 wait complete. 2024-09-06T15:19:51.619 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:19:51.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:51.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:51.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:51.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[22757]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:51.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:51 smithi189 bash[29727]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:52.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:52.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: cluster 2024-09-06T15:19:49.962655+0000 mgr.y (mgr.14631) 258 : cluster [DBG] pgmap v183: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:52.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:52.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: audit 2024-09-06T15:19:50.797413+0000 mon.c (mon.2) 128 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:19:52.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:52.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:51 smithi190 bash[24979]: audit 2024-09-06T15:19:50.909510+0000 mon.c (mon.2) 129 : audit [DBG] from='client.? v1:172.21.15.189:0/562737374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:19:52.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:19:52 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:19:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:19:53.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:52 smithi189 bash[29727]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:53.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:52 smithi189 bash[29727]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:53.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:52 smithi189 bash[22757]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:53.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:52 smithi189 bash[22757]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:53.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:52 smithi190 bash[24979]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:53.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:52 smithi190 bash[24979]: audit 2024-09-06T15:19:51.124693+0000 mgr.y (mgr.14631) 259 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:19:54.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:53 smithi189 bash[22757]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:53 smithi189 bash[22757]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:53 smithi189 bash[29727]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:53 smithi189 bash[29727]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:53 smithi190 bash[24979]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:53 smithi190 bash[24979]: cluster 2024-09-06T15:19:51.964117+0000 mgr.y (mgr.14631) 260 : cluster [DBG] pgmap v184: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:54.544 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:19:56.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:55 smithi189 bash[22757]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:56.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:55 smithi189 bash[22757]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:56.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:55 smithi189 bash[29727]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:56.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:55 smithi189 bash[29727]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:56.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:55 smithi190 bash[24979]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:56.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:55 smithi190 bash[24979]: cluster 2024-09-06T15:19:53.964829+0000 mgr.y (mgr.14631) 261 : cluster [DBG] pgmap v185: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:19:58.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:57 smithi189 bash[22757]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:58.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:57 smithi189 bash[22757]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:58.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:57 smithi189 bash[29727]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:58.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:57 smithi189 bash[29727]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:58.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:57 smithi190 bash[24979]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:58.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:57 smithi190 bash[24979]: cluster 2024-09-06T15:19:55.966363+0000 mgr.y (mgr.14631) 262 : cluster [DBG] pgmap v186: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:19:59.349 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:20:00.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:59 smithi189 bash[29727]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:19:59 smithi189 bash[29727]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:59 smithi189 bash[22757]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:19:59 smithi189 bash[22757]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:59 smithi190 bash[24979]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:19:59 smithi190 bash[24979]: cluster 2024-09-06T15:19:57.967233+0000 mgr.y (mgr.14631) 263 : cluster [DBG] pgmap v187: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:00.600 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.599+0000 7f1c51825640 1 -- 172.21.15.189:0/2484320399 >> v1:172.21.15.189:6790/0 conn(0x7f1c4c10f100 legacy=0x7f1c4c1114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2484320399 shutdown_connections 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2484320399 >> 172.21.15.189:0/2484320399 conn(0x7f1c4c0fd240 msgr2=0x7f1c4c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2484320399 shutdown_connections 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2484320399 wait complete. 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 Processor -- start 2024-09-06T15:20:00.601 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- start start 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c4c10b2a0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c4c1a8b90 con 0x7f1c4c1037e0 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f1c4c1a9d70 con 0x7f1c4c10f100 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c4a7fc640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f1c4c10b5f0 0x7f1c4c1088e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:56470/0 (socket says 172.21.15.189:56470) 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c4a7fc640 1 -- 172.21.15.189:0/2170843681 learned_addr learned my addr 172.21.15.189:0/2170843681 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456179237 0 0) 0x7f1c4c10b2a0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c34003520 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490745461 0 0) 0x7f1c4c1a9d70 con 0x7f1c4c10f100 2024-09-06T15:20:00.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c4c10b2a0 con 0x7f1c4c10f100 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746583788 0 0) 0x7f1c4c1a8b90 con 0x7f1c4c1037e0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c4c1a9d70 con 0x7f1c4c1037e0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4272184915 0 0) 0x7f1c34003520 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c4c1a8b90 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3454745967 0 0) 0x7f1c4c10b2a0 con 0x7f1c4c10f100 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c34003520 con 0x7f1c4c10f100 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c3c0019f0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c440017b0 con 0x7f1c4c10f100 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 905829576 0 0) 0x7f1c4c1a8b90 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 >> v1:172.21.15.189:6790/0 conn(0x7f1c4c10f100 legacy=0x7f1c4c1a6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 >> v1:172.21.15.190:6789/0 conn(0x7f1c4c1037e0 legacy=0x7f1c4c1081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:00.604 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1aaf50 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c1a9fa0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1aa550 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f1c3c003d30 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f1c3c005c50 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c380050b0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.603+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f1c3c0038c0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.605 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.607+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f1c3c094cc0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.608 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.611+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f1c3c05dc40 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.812 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.811+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1c380053a0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.812 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c50823640 1 -- 172.21.15.189:0/2170843681 <== mon.0 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f1c3c061db0 con 0x7f1c4c10b5f0 2024-09-06T15:20:00.813 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:20:00.813 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:20:00.814 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 >> v1:172.21.15.189:6800/1420554776 conn(0x7f1c34078410 legacy=0x7f1c3407a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:00.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 >> v1:172.21.15.189:6789/0 conn(0x7f1c4c10b5f0 legacy=0x7f1c4c1088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:00.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 shutdown_connections 2024-09-06T15:20:00.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 >> 172.21.15.189:0/2170843681 conn(0x7f1c4c0fd240 msgr2=0x7f1c4c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:00.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 shutdown_connections 2024-09-06T15:20:00.815 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:00.815+0000 7f1c51825640 1 -- 172.21.15.189:0/2170843681 wait complete. 2024-09-06T15:20:01.014 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:00 smithi189 bash[22757]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.014 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:00 smithi189 bash[22757]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:00 smithi189 bash[29727]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:00 smithi189 bash[29727]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:00 smithi190 bash[24979]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:00 smithi190 bash[24979]: cluster 2024-09-06T15:20:00.000158+0000 mon.a (mon.0) 873 : cluster [WRN] overall HEALTH_WARN Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:20:01.619 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:20:01 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:20:02.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[22757]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[22757]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[22757]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[22757]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[29727]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[29727]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[29727]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:01 smithi189 bash[29727]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:01 smithi190 bash[24979]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:01 smithi190 bash[24979]: cluster 2024-09-06T15:19:59.968108+0000 mgr.y (mgr.14631) 264 : cluster [DBG] pgmap v188: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:02.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:01 smithi190 bash[24979]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:01 smithi190 bash[24979]: audit 2024-09-06T15:20:00.818818+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? v1:172.21.15.189:0/2170843681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:02.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:02 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:20:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:20:03.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:02 smithi189 bash[22757]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:03.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:02 smithi189 bash[22757]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:03.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:02 smithi189 bash[29727]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:03.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:02 smithi189 bash[29727]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:03.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:02 smithi190 bash[24979]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:03.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:02 smithi190 bash[24979]: audit 2024-09-06T15:20:01.132487+0000 mgr.y (mgr.14631) 265 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:04.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:03 smithi189 bash[29727]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:03 smithi189 bash[29727]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:03 smithi189 bash[22757]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:03 smithi189 bash[22757]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:03 smithi190 bash[24979]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:03 smithi190 bash[24979]: cluster 2024-09-06T15:20:01.969633+0000 mgr.y (mgr.14631) 266 : cluster [DBG] pgmap v189: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:04.466 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:20:06.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:05 smithi189 bash[22757]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:06.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:05 smithi189 bash[22757]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:06.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:05 smithi189 bash[29727]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:06.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:05 smithi189 bash[29727]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:06.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:05 smithi190 bash[24979]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:06.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:05 smithi190 bash[24979]: cluster 2024-09-06T15:20:03.970285+0000 mgr.y (mgr.14631) 267 : cluster [DBG] pgmap v190: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:07.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:06 smithi189 bash[22757]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:07.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:06 smithi189 bash[22757]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:07.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:06 smithi189 bash[29727]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:07.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:06 smithi189 bash[29727]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:07.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:06 smithi190 bash[24979]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:07.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:06 smithi190 bash[24979]: audit 2024-09-06T15:20:05.823719+0000 mon.c (mon.2) 130 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:20:08.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:07 smithi189 bash[22757]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:08.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:07 smithi189 bash[22757]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:08.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:07 smithi189 bash[29727]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:08.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:07 smithi189 bash[29727]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:08.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:07 smithi190 bash[24979]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:08.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:07 smithi190 bash[24979]: cluster 2024-09-06T15:20:05.971743+0000 mgr.y (mgr.14631) 268 : cluster [DBG] pgmap v191: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:09.267 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:20:10.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:09 smithi189 bash[22757]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:09 smithi189 bash[22757]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:09 smithi189 bash[29727]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:09 smithi189 bash[29727]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:09 smithi190 bash[24979]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:09 smithi190 bash[24979]: cluster 2024-09-06T15:20:07.972446+0000 mgr.y (mgr.14631) 269 : cluster [DBG] pgmap v192: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:10.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/3526772287 >> v1:172.21.15.189:6789/0 conn(0x7fc53410b5e0 legacy=0x7fc53410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:10.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/3526772287 shutdown_connections 2024-09-06T15:20:10.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/3526772287 >> 172.21.15.189:0/3526772287 conn(0x7fc5340fd210 msgr2=0x7fc5340ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:10.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/3526772287 shutdown_connections 2024-09-06T15:20:10.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/3526772287 wait complete. 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 Processor -- start 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- start start 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc5341a75e0 con 0x7fc53410b5e0 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc5341a87e0 con 0x7fc5341037d0 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7fc5341a99e0 con 0x7fc53410f0f0 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc538b15640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fc53410b5e0 0x7fc5341a2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:48636/0 (socket says 172.21.15.189:48636) 2024-09-06T15:20:10.512 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc538b15640 1 -- 172.21.15.189:0/2062299913 learned_addr learned my addr 172.21.15.189:0/2062299913 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285137339 0 0) 0x7fc5341a99e0 con 0x7fc53410f0f0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc520003240 con 0x7fc53410f0f0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661209901 0 0) 0x7fc5341a75e0 con 0x7fc53410b5e0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5341a99e0 con 0x7fc53410b5e0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2111032255 0 0) 0x7fc520003240 con 0x7fc53410f0f0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5341a75e0 con 0x7fc53410f0f0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc52c001770 con 0x7fc53410f0f0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 31913865 0 0) 0x7fc5341a99e0 con 0x7fc53410b5e0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc520003240 con 0x7fc53410b5e0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc530001530 con 0x7fc53410b5e0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268395648 0 0) 0x7fc5341a87e0 con 0x7fc5341037d0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5341a99e0 con 0x7fc5341037d0 2024-09-06T15:20:10.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 630365722 0 0) 0x7fc5341a75e0 con 0x7fc53410f0f0 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 >> v1:172.21.15.190:6789/0 conn(0x7fc5341037d0 legacy=0x7fc53410ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 >> v1:172.21.15.189:6789/0 conn(0x7fc53410b5e0 legacy=0x7fc5341a2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5341aac80 con 0x7fc53410f0f0 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5341a7810 con 0x7fc53410f0f0 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5341a7e40 con 0x7fc53410f0f0 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7fc52c003de0 con 0x7fc53410f0f0 2024-09-06T15:20:10.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.510+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7fc52c004c60 con 0x7fc53410f0f0 2024-09-06T15:20:10.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.514+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5180050b0 con 0x7fc53410f0f0 2024-09-06T15:20:10.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.514+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7fc52c003f90 con 0x7fc53410f0f0 2024-09-06T15:20:10.515 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.514+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7fc52c093d10 con 0x7fc53410f0f0 2024-09-06T15:20:10.518 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.518+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7fc52c05cc90 con 0x7fc53410f0f0 2024-09-06T15:20:10.722 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.722+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5180053a0 con 0x7fc53410f0f0 2024-09-06T15:20:10.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.722+0000 7fc52a7fc640 1 -- 172.21.15.189:0/2062299913 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7fc52c060e00 con 0x7fc53410f0f0 2024-09-06T15:20:10.723 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:20:10.723 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 >> v1:172.21.15.189:6800/1420554776 conn(0x7fc520078430 legacy=0x7fc52007a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 >> v1:172.21.15.189:6790/0 conn(0x7fc53410f0f0 legacy=0x7fc5341a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 shutdown_connections 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 >> 172.21.15.189:0/2062299913 conn(0x7fc5340fd210 msgr2=0x7fc5340ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 shutdown_connections 2024-09-06T15:20:10.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:10.726+0000 7fc53b57a640 1 -- 172.21.15.189:0/2062299913 wait complete. 2024-09-06T15:20:11.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:10 smithi189 bash[22757]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.161 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:10 smithi189 bash[22757]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:10 smithi189 bash[29727]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:10 smithi189 bash[29727]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.163 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:10 smithi190 bash[24979]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.163 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:10 smithi190 bash[24979]: audit 2024-09-06T15:20:10.728870+0000 mon.c (mon.2) 131 : audit [DBG] from='client.? v1:172.21.15.189:0/2062299913' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:11.619 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:20:11 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:20:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:11 smithi189 bash[22757]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:11 smithi189 bash[22757]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:11 smithi189 bash[29727]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:11 smithi189 bash[29727]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:11 smithi190 bash[24979]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:11 smithi190 bash[24979]: cluster 2024-09-06T15:20:09.973143+0000 mgr.y (mgr.14631) 270 : cluster [DBG] pgmap v193: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:12.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:12 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:20:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:20:13.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:12 smithi189 bash[22757]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:13.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:12 smithi189 bash[22757]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:13.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:12 smithi189 bash[29727]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:13.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:12 smithi189 bash[29727]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:13.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:12 smithi190 bash[24979]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:13.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:12 smithi190 bash[24979]: audit 2024-09-06T15:20:11.140244+0000 mgr.y (mgr.14631) 271 : audit [DBG] from='client.24493 v1:172.21.15.190:0/1462796642' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-06T15:20:14.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:13 smithi189 bash[22757]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:13 smithi189 bash[22757]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:13 smithi189 bash[29727]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:13 smithi189 bash[29727]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:13 smithi190 bash[24979]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:13 smithi190 bash[24979]: cluster 2024-09-06T15:20:11.974674+0000 mgr.y (mgr.14631) 272 : cluster [DBG] pgmap v194: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:14.377 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 shell --fsid de31ad16-6c60-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T15:20:16.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:15 smithi189 bash[22757]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:16.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:15 smithi189 bash[22757]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:16.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:15 smithi189 bash[29727]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:16.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:15 smithi189 bash[29727]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:16.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:15 smithi190 bash[24979]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:16.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:15 smithi190 bash[24979]: cluster 2024-09-06T15:20:13.975335+0000 mgr.y (mgr.14631) 273 : cluster [DBG] pgmap v195: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:17 smithi189 bash[22757]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:18.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:17 smithi189 bash[22757]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:18.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:17 smithi189 bash[29727]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:18.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:17 smithi189 bash[29727]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:18.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:17 smithi190 bash[24979]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:18.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:17 smithi190 bash[24979]: cluster 2024-09-06T15:20:15.976745+0000 mgr.y (mgr.14631) 274 : cluster [DBG] pgmap v196: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-06T15:20:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:18 smithi189 bash[22757]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:18 smithi189 bash[22757]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:18 smithi189 bash[29727]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:18 smithi189 bash[29727]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:18 smithi190 bash[24979]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:18 smithi190 bash[24979]: audit 2024-09-06T15:20:18.708426+0000 mon.c (mon.2) 132 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:20:19.185 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/mon.a/config 2024-09-06T15:20:20.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[22757]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.100 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:19 smithi189 bash[29727]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: cluster 2024-09-06T15:20:17.977449+0000 mgr.y (mgr.14631) 275 : cluster [DBG] pgmap v197: 132 pgs: 132 active+clean; 583 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.429951+0000 mon.c (mon.2) 133 : audit [DBG] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.431199+0000 mon.c (mon.2) 134 : audit [INF] from='mgr.14631 v1:172.21.15.189:0/2183940753' entity='mgr.y' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:20:20.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.120 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:19 smithi190 bash[24979]: audit 2024-09-06T15:20:19.439620+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14631 ' entity='mgr.y' 2024-09-06T15:20:20.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/2116004842 >> v1:172.21.15.189:6790/0 conn(0x7f2ed010f1a0 legacy=0x7f2ed0111590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:20.294 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/2116004842 shutdown_connections 2024-09-06T15:20:20.294 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/2116004842 >> 172.21.15.189:0/2116004842 conn(0x7f2ed00fd240 msgr2=0x7f2ed00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:20.294 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/2116004842 shutdown_connections 2024-09-06T15:20:20.295 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/2116004842 wait complete. 2024-09-06T15:20:20.296 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 Processor -- start 2024-09-06T15:20:20.296 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- start start 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ed019f320 con 0x7f2ed01036b0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ed019f510 con 0x7f2ed010b690 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 34 bytes epoch 0) -- 0x7f2ed01b0040 con 0x7f2ed010f1a0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed6422640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2ed01036b0 0x7f2ed0102db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:59786/0 (socket says 172.21.15.189:59786) 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed6422640 1 -- 172.21.15.189:0/3044308596 learned_addr learned my addr 172.21.15.189:0/3044308596 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.0 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034295576 0 0) 0x7f2ed019f320 con 0x7f2ed01036b0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ebc003520 con 0x7f2ed01036b0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178395707 0 0) 0x7f2ed01b0040 con 0x7f2ed010f1a0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ed019f320 con 0x7f2ed010f1a0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898183660 0 0) 0x7f2ed019f320 con 0x7f2ed010f1a0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ed01b0040 con 0x7f2ed010f1a0 2024-09-06T15:20:20.297 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.0 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 926526434 0 0) 0x7f2ebc003520 con 0x7f2ed01036b0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ed019f320 con 0x7f2ed01036b0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2ec8001900 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.0 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2ecc001310 con 0x7f2ed01036b0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2006820205 0 0) 0x7f2ed01b0040 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 >> v1:172.21.15.190:6789/0 conn(0x7f2ed010b690 legacy=0x7f2ed019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 >> v1:172.21.15.189:6789/0 conn(0x7f2ed01036b0 legacy=0x7f2ed0102db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed01b1220 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed01b0270 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ed01b08a0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 5 ==== config(24 keys) ==== 1029+0+0 (unknown 586775146 0 0) 0x7f2ec8001e10 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1013476354 0 0) 0x7f2ec8004dc0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb40050b0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.290+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 21) ==== 99844+0+0 (unknown 738612999 0 0) 0x7f2ec8003970 con 0x7f2ed010f1a0 2024-09-06T15:20:20.298 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.294+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 8 ==== osd_map(67..67 src has 1..67) ==== 6072+0+0 (unknown 146673869 0 0) 0x7f2ec8093eb0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.298+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (unknown 1092875540 0 1091003085) 0x7f2ec805ce30 con 0x7f2ed010f1a0 2024-09-06T15:20:20.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.498+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2eb40053a0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.498+0000 7f2ec77fe640 1 -- 172.21.15.189:0/3044308596 <== mon.2 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+212 (unknown 3730786198 0 4063571736) 0x7f2ec8060fa0 con 0x7f2ed010f1a0 2024-09-06T15:20:20.499 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-06T15:20:20.499 INFO:teuthology.orchestra.run.smithi189.stdout:{"status":"HEALTH_WARN","checks":{"MGR_MODULE_DEPENDENCY":{"severity":"HEALTH_WARN","summary":{"message":"Module 'volumes' has failed dependency: No module named 'ceph.fs'","count":1},"muted":false}},"mutes":[]} 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 >> v1:172.21.15.189:6800/1420554776 conn(0x7f2ebc078390 legacy=0x7f2ebc07a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 >> v1:172.21.15.189:6790/0 conn(0x7f2ed010f1a0 legacy=0x7f2ed019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 shutdown_connections 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 >> 172.21.15.189:0/3044308596 conn(0x7f2ed00fd240 msgr2=0x7f2ed00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 shutdown_connections 2024-09-06T15:20:20.501 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-06T15:20:20.502+0000 7f2ed8686640 1 -- 172.21.15.189:0/3044308596 wait complete. 2024-09-06T15:20:21.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:20 smithi189 bash[22757]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.098 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:20 smithi189 bash[22757]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:20 smithi189 bash[29727]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:20 smithi189 bash[29727]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:20 smithi190 bash[24979]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.119 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:20 smithi190 bash[24979]: audit 2024-09-06T15:20:20.504793+0000 mon.c (mon.2) 135 : audit [DBG] from='client.? v1:172.21.15.189:0/3044308596' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-06T15:20:21.188 INFO:tasks.cephadm:Teardown begin 2024-09-06T15:20:21.188 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephadm.py", line 2371, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-06T15:20:21.421 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:20:21.436 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:20:21.447 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:20:21 smithi190 bash[49459]: debug there is no tcmu-runner data available 2024-09-06T15:20:21.451 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-06T15:20:21.451 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-06T15:20:21.485 DEBUG:teuthology.orchestra.run.smithi190:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-06T15:20:21.498 INFO:tasks.cephadm:Stopping all daemons... 2024-09-06T15:20:21.498 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-06T15:20:21.498 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a 2024-09-06T15:20:21.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:21 smithi189 systemd[1]: Stopping Ceph mon.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:21.848 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:21 smithi189 bash[22757]: debug 2024-09-06T15:20:21.654+0000 7ff6d6738640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-06T15:20:21.849 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:21 smithi189 bash[22757]: debug 2024-09-06T15:20:21.654+0000 7ff6d6738640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-06T15:20:22.488 INFO:journalctl@ceph.mon.a.smithi189.stdout:Sep 06 15:20:22 smithi189 bash[66514]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-mon-a 2024-09-06T15:20:22.488 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:22 smithi189 bash[23007]: ::ffff:172.21.15.190 - - [06/Sep/2024:15:20:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.51.0" 2024-09-06T15:20:22.502 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.a.service' 2024-09-06T15:20:22.535 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:22.535 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-06T15:20:22.535 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-06T15:20:22.535 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.c 2024-09-06T15:20:22.848 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:22 smithi189 bash[23007]: [06/Sep/2024:15:20:22] ENGINE Bus STOPPING 2024-09-06T15:20:22.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:22 smithi189 systemd[1]: Stopping Ceph mon.c for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:22.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:22 smithi189 bash[29727]: debug 2024-09-06T15:20:22.714+0000 7fd15a987640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-06T15:20:22.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:22 smithi189 bash[29727]: debug 2024-09-06T15:20:22.714+0000 7fd15a987640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-06T15:20:23.275 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[23007]: [06/Sep/2024:15:20:23] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-06T15:20:23.275 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[23007]: [06/Sep/2024:15:20:23] ENGINE Bus STOPPED 2024-09-06T15:20:23.275 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[23007]: [06/Sep/2024:15:20:23] ENGINE Bus STARTING 2024-09-06T15:20:23.276 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[23007]: [06/Sep/2024:15:20:23] ENGINE Serving on http://:::9283 2024-09-06T15:20:23.598 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[23007]: [06/Sep/2024:15:20:23] ENGINE Bus STARTED 2024-09-06T15:20:23.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 06 15:20:23 smithi189 bash[66616]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-mon-c 2024-09-06T15:20:23.635 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.c.service' 2024-09-06T15:20:23.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:23.664 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-06T15:20:23.664 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-06T15:20:23.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.b 2024-09-06T15:20:23.955 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:23 smithi190 systemd[1]: Stopping Ceph mon.b for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:23.955 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:23 smithi190 bash[24979]: debug 2024-09-06T15:20:23.821+0000 7f34636d2640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-06T15:20:23.955 INFO:journalctl@ceph.mon.b.smithi190.stdout:Sep 06 15:20:23 smithi190 bash[24979]: debug 2024-09-06T15:20:23.821+0000 7f34636d2640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-06T15:20:24.692 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mon.b.service' 2024-09-06T15:20:24.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:24.724 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-06T15:20:24.724 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-06T15:20:24.724 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y 2024-09-06T15:20:25.070 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:24 smithi189 systemd[1]: Stopping Ceph mgr.y for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:25.070 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:24 smithi189 bash[23007]: debug 2024-09-06T15:20:24.870+0000 7f9003186640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:25.070 INFO:journalctl@ceph.mgr.y.smithi189.stdout:Sep 06 15:20:24 smithi189 bash[23007]: debug 2024-09-06T15:20:24.870+0000 7f9003186640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-06T15:20:25.625 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.y.service' 2024-09-06T15:20:25.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:25.650 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-06T15:20:25.650 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-06T15:20:25.650 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.x 2024-09-06T15:20:25.987 INFO:journalctl@ceph.mgr.x.smithi190.stdout:Sep 06 15:20:25 smithi190 systemd[1]: Stopping Ceph mgr.x for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:26.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@mgr.x.service' 2024-09-06T15:20:26.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:26.550 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-06T15:20:26.550 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-06T15:20:26.551 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.0 2024-09-06T15:20:26.849 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:26 smithi189 systemd[1]: Stopping Ceph osd.0 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:26.849 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:26 smithi189 bash[32593]: debug 2024-09-06T15:20:26.710+0000 7f0a6f391640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:26.849 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:26 smithi189 bash[32593]: debug 2024-09-06T15:20:26.710+0000 7f0a6f391640 -1 osd.0 67 *** Got signal Terminated *** 2024-09-06T15:20:26.849 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:26 smithi189 bash[32593]: debug 2024-09-06T15:20:26.710+0000 7f0a6f391640 -1 osd.0 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:20:32.848 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:32 smithi189 bash[66826]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-0 2024-09-06T15:20:32.849 INFO:journalctl@ceph.osd.0.smithi189.stdout:Sep 06 15:20:32 smithi189 bash[66891]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-0 2024-09-06T15:20:34.568 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.0.service' 2024-09-06T15:20:34.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:34.596 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-06T15:20:34.596 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-06T15:20:34.597 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.1 2024-09-06T15:20:34.849 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:34 smithi189 systemd[1]: Stopping Ceph osd.1 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:34.849 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:34 smithi189 bash[38147]: debug 2024-09-06T15:20:34.766+0000 7f8286353640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:34.849 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:34 smithi189 bash[38147]: debug 2024-09-06T15:20:34.766+0000 7f8286353640 -1 osd.1 67 *** Got signal Terminated *** 2024-09-06T15:20:34.849 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:34 smithi189 bash[38147]: debug 2024-09-06T15:20:34.766+0000 7f8286353640 -1 osd.1 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:20:41.064 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:40 smithi189 bash[67021]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-1 2024-09-06T15:20:41.064 INFO:journalctl@ceph.osd.1.smithi189.stdout:Sep 06 15:20:40 smithi189 bash[67087]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-1 2024-09-06T15:20:42.778 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.1.service' 2024-09-06T15:20:42.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:42.807 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-06T15:20:42.808 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-06T15:20:42.808 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.2 2024-09-06T15:20:43.099 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:42 smithi189 systemd[1]: Stopping Ceph osd.2 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:43.099 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:42 smithi189 bash[43682]: debug 2024-09-06T15:20:42.978+0000 7f9a5c2b8640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:43.099 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:42 smithi189 bash[43682]: debug 2024-09-06T15:20:42.978+0000 7f9a5c2b8640 -1 osd.2 67 *** Got signal Terminated *** 2024-09-06T15:20:43.099 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:42 smithi189 bash[43682]: debug 2024-09-06T15:20:42.978+0000 7f9a5c2b8640 -1 osd.2 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:20:49.188 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:48 smithi189 bash[67216]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-2 2024-09-06T15:20:49.188 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 06 15:20:49 smithi189 bash[67279]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-2 2024-09-06T15:20:50.828 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.2.service' 2024-09-06T15:20:50.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:50.856 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-06T15:20:50.856 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-06T15:20:50.856 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.3 2024-09-06T15:20:51.098 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:50 smithi189 systemd[1]: Stopping Ceph osd.3 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:51.099 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:51 smithi189 bash[49505]: debug 2024-09-06T15:20:51.033+0000 7f2b46393640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:51.099 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:51 smithi189 bash[49505]: debug 2024-09-06T15:20:51.033+0000 7f2b46393640 -1 osd.3 67 *** Got signal Terminated *** 2024-09-06T15:20:51.099 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:51 smithi189 bash[49505]: debug 2024-09-06T15:20:51.033+0000 7f2b46393640 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:20:54.013 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:53 smithi190 bash[39614]: debug 2024-09-06T15:20:53.797+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:54.013 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:53 smithi190 bash[45319]: debug 2024-09-06T15:20:53.677+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:54.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:54 smithi190 bash[33981]: debug 2024-09-06T15:20:54.021+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:54.967 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:54 smithi190 bash[39614]: debug 2024-09-06T15:20:54.773+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:54.967 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:54 smithi190 bash[28364]: debug 2024-09-06T15:20:54.761+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:54.967 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:54 smithi190 bash[45319]: debug 2024-09-06T15:20:54.661+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:55.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:54 smithi190 bash[33981]: debug 2024-09-06T15:20:54.977+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:55.976 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:55 smithi190 bash[28364]: debug 2024-09-06T15:20:55.717+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:55.976 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:55 smithi190 bash[39614]: debug 2024-09-06T15:20:55.793+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:55.976 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:55 smithi190 bash[45319]: debug 2024-09-06T15:20:55.661+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:56.369 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:55 smithi190 bash[33981]: debug 2024-09-06T15:20:55.985+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:56.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:56 smithi190 bash[39614]: debug 2024-09-06T15:20:56.813+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:56.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:56 smithi190 bash[45319]: debug 2024-09-06T15:20:56.629+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:56.869 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:56 smithi190 bash[28364]: debug 2024-09-06T15:20:56.697+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:57.175 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:56 smithi189 bash[67409]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-3 2024-09-06T15:20:57.176 INFO:journalctl@ceph.osd.3.smithi189.stdout:Sep 06 15:20:57 smithi189 bash[67473]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-3 2024-09-06T15:20:57.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:56 smithi190 bash[33981]: debug 2024-09-06T15:20:56.949+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:57.868 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:57 smithi190 bash[28364]: debug 2024-09-06T15:20:57.709+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:57.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:57 smithi190 bash[39614]: debug 2024-09-06T15:20:57.765+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:57.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:57 smithi190 bash[45319]: debug 2024-09-06T15:20:57.621+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:58.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:57 smithi190 bash[33981]: debug 2024-09-06T15:20:57.973+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:58.894 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.3.service' 2024-09-06T15:20:58.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:20:58.921 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-06T15:20:58.921 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-06T15:20:58.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.4 2024-09-06T15:20:58.933 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:58 smithi190 bash[45319]: debug 2024-09-06T15:20:58.649+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:58.933 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:58 smithi190 bash[39614]: debug 2024-09-06T15:20:58.741+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:20:58.933 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:58 smithi190 bash[28364]: debug 2024-09-06T15:20:58.749+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:59.369 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:20:58 smithi190 bash[33981]: debug 2024-09-06T15:20:58.961+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:20:59.369 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:58 smithi190 systemd[1]: Stopping Ceph osd.4 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:20:59.369 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[28364]: debug 2024-09-06T15:20:59.085+0000 7f9151b42640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:20:59.369 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[28364]: debug 2024-09-06T15:20:59.085+0000 7f9151b42640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-06T15:20:59.369 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[28364]: debug 2024-09-06T15:20:59.085+0000 7f9151b42640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:20:59.991 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[45319]: debug 2024-09-06T15:20:59.669+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:20:59.992 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[28364]: debug 2024-09-06T15:20:59.769+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:20:59.992 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:20:59 smithi190 bash[39614]: debug 2024-09-06T15:20:59.765+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:00.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:00 smithi190 bash[33981]: debug 2024-09-06T15:21:00.001+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:00.868 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:00 smithi190 bash[28364]: debug 2024-09-06T15:21:00.729+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:21:00.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:00 smithi190 bash[39614]: debug 2024-09-06T15:21:00.761+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:00.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:00 smithi190 bash[45319]: debug 2024-09-06T15:21:00.629+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:00.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:00 smithi190 bash[45319]: debug 2024-09-06T15:21:00.629+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:01.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[33981]: debug 2024-09-06T15:21:01.025+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:01.369 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[33981]: debug 2024-09-06T15:21:01.025+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:01.868 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[28364]: debug 2024-09-06T15:21:01.733+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:21:01.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[39614]: debug 2024-09-06T15:21:01.713+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:01.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[45319]: debug 2024-09-06T15:21:01.617+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:01.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[45319]: debug 2024-09-06T15:21:01.617+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:02.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[33981]: debug 2024-09-06T15:21:02.061+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:02.369 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[33981]: debug 2024-09-06T15:21:02.061+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.977Z caller=refresh.go:90 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.979Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.982Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.984Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.989Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=nfs msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=nfs\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:02.369 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:01 smithi190 bash[52448]: ts=2024-09-06T15:21:01.989Z caller=refresh.go:90 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.189:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.189:8765: connect: connection refused" 2024-09-06T15:21:03.081 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[28364]: debug 2024-09-06T15:21:02.721+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:21:03.082 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[39614]: debug 2024-09-06T15:21:02.745+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:03.082 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[45319]: debug 2024-09-06T15:21:02.665+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:03.082 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:02 smithi190 bash[45319]: debug 2024-09-06T15:21:02.665+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:03.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[33981]: debug 2024-09-06T15:21:03.093+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:03.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[33981]: debug 2024-09-06T15:21:03.093+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:04.072 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[28364]: debug 2024-09-06T15:21:03.741+0000 7f914e157640 -1 osd.4 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.081172+0000 front 2024-09-06T15:20:28.081115+0000 (oldest deadline 2024-09-06T15:20:53.980976+0000) 2024-09-06T15:21:04.073 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[39614]: debug 2024-09-06T15:21:03.761+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:04.073 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[39614]: debug 2024-09-06T15:21:03.761+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:04.073 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[45319]: debug 2024-09-06T15:21:03.685+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:04.073 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:03 smithi190 bash[45319]: debug 2024-09-06T15:21:03.685+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:04.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[33981]: debug 2024-09-06T15:21:04.081+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:04.368 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[33981]: debug 2024-09-06T15:21:04.081+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:04.795 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[45319]: debug 2024-09-06T15:21:04.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:04.795 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[45319]: debug 2024-09-06T15:21:04.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:05.118 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[53604]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-4 2024-09-06T15:21:05.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[39614]: debug 2024-09-06T15:21:04.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:05.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:04 smithi190 bash[39614]: debug 2024-09-06T15:21:04.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:05.582 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[53669]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-4 2024-09-06T15:21:05.583 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[33981]: debug 2024-09-06T15:21:05.129+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:05.583 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[33981]: debug 2024-09-06T15:21:05.129+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:05.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[39614]: debug 2024-09-06T15:21:05.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:05.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[39614]: debug 2024-09-06T15:21:05.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:05.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[45319]: debug 2024-09-06T15:21:05.593+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:05.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:05 smithi190 bash[45319]: debug 2024-09-06T15:21:05.593+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:06.462 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[33981]: debug 2024-09-06T15:21:06.133+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:06.462 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[33981]: debug 2024-09-06T15:21:06.133+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:06.716 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[45319]: debug 2024-09-06T15:21:06.625+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:06.716 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[45319]: debug 2024-09-06T15:21:06.625+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:07.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[39614]: debug 2024-09-06T15:21:06.765+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:07.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:06 smithi190 bash[39614]: debug 2024-09-06T15:21:06.765+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:07.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.4.service' 2024-09-06T15:21:07.378 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:07 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-06T15:21:07.379 INFO:journalctl@ceph.osd.4.smithi190.stdout:Sep 06 15:21:07 smithi190 systemd[1]: Stopped Ceph osd.4 for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:21:07.379 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[33981]: debug 2024-09-06T15:21:07.133+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:07.379 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[33981]: debug 2024-09-06T15:21:07.133+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:07.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:07.397 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-06T15:21:07.397 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-06T15:21:07.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.5 2024-09-06T15:21:07.579 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 systemd[1]: Stopping Ceph osd.5 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:07.794 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[33981]: debug 2024-09-06T15:21:07.589+0000 7f08845a5640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:21:07.794 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[33981]: debug 2024-09-06T15:21:07.589+0000 7f08845a5640 -1 osd.5 67 *** Got signal Terminated *** 2024-09-06T15:21:07.794 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[33981]: debug 2024-09-06T15:21:07.589+0000 7f08845a5640 -1 osd.5 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:21:07.795 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[45319]: debug 2024-09-06T15:21:07.593+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:07.795 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[45319]: debug 2024-09-06T15:21:07.593+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:08.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[39614]: debug 2024-09-06T15:21:07.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:08.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:07 smithi190 bash[39614]: debug 2024-09-06T15:21:07.805+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:08.601 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[33981]: debug 2024-09-06T15:21:08.161+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:08.601 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[33981]: debug 2024-09-06T15:21:08.161+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:08.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[39614]: debug 2024-09-06T15:21:08.773+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:08.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[39614]: debug 2024-09-06T15:21:08.773+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:08.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[45319]: debug 2024-09-06T15:21:08.609+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:08.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:08 smithi190 bash[45319]: debug 2024-09-06T15:21:08.609+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:09.618 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[33981]: debug 2024-09-06T15:21:09.177+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:09.618 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[33981]: debug 2024-09-06T15:21:09.177+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:10.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[39614]: debug 2024-09-06T15:21:09.745+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:10.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[39614]: debug 2024-09-06T15:21:09.745+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:10.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[45319]: debug 2024-09-06T15:21:09.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:10.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[45319]: debug 2024-09-06T15:21:09.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:10.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:09 smithi190 bash[45319]: debug 2024-09-06T15:21:09.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:10.618 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[33981]: debug 2024-09-06T15:21:10.205+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:10.618 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[33981]: debug 2024-09-06T15:21:10.205+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:10.619 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[33981]: debug 2024-09-06T15:21:10.205+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:43.672540+0000 front 2024-09-06T15:20:43.672816+0000 (oldest deadline 2024-09-06T15:21:09.572523+0000) 2024-09-06T15:21:11.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[39614]: debug 2024-09-06T15:21:10.713+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:11.118 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[39614]: debug 2024-09-06T15:21:10.713+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:11.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[45319]: debug 2024-09-06T15:21:10.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:11.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[45319]: debug 2024-09-06T15:21:10.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:11.119 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:10 smithi190 bash[45319]: debug 2024-09-06T15:21:10.637+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:11.617 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[33981]: debug 2024-09-06T15:21:11.213+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:11.617 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[33981]: debug 2024-09-06T15:21:11.213+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:11.617 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[33981]: debug 2024-09-06T15:21:11.213+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:43.672540+0000 front 2024-09-06T15:20:43.672816+0000 (oldest deadline 2024-09-06T15:21:09.572523+0000) 2024-09-06T15:21:11.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[39614]: debug 2024-09-06T15:21:11.685+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:11.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[39614]: debug 2024-09-06T15:21:11.685+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:11.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[39614]: debug 2024-09-06T15:21:11.685+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:11.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[45319]: debug 2024-09-06T15:21:11.625+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:11.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[45319]: debug 2024-09-06T15:21:11.625+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:11.870 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:11 smithi190 bash[45319]: debug 2024-09-06T15:21:11.625+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:12.605 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[33981]: debug 2024-09-06T15:21:12.217+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.769811+0000 front 2024-09-06T15:20:29.769776+0000 (oldest deadline 2024-09-06T15:20:53.869390+0000) 2024-09-06T15:21:12.606 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[33981]: debug 2024-09-06T15:21:12.217+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.171010+0000 front 2024-09-06T15:20:36.170912+0000 (oldest deadline 2024-09-06T15:21:00.870675+0000) 2024-09-06T15:21:12.606 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[33981]: debug 2024-09-06T15:21:12.217+0000 7f087cbb2640 -1 osd.5 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:43.672540+0000 front 2024-09-06T15:20:43.672816+0000 (oldest deadline 2024-09-06T15:21:09.572523+0000) 2024-09-06T15:21:12.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[39614]: debug 2024-09-06T15:21:12.709+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:12.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[39614]: debug 2024-09-06T15:21:12.709+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:12.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[39614]: debug 2024-09-06T15:21:12.709+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:12.872 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[45319]: debug 2024-09-06T15:21:12.613+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:12.872 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[45319]: debug 2024-09-06T15:21:12.613+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:12.872 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:12 smithi190 bash[45319]: debug 2024-09-06T15:21:12.613+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:13.979 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[53799]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-5 2024-09-06T15:21:13.979 INFO:journalctl@ceph.osd.5.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[53863]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-5 2024-09-06T15:21:13.979 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[45319]: debug 2024-09-06T15:21:13.632+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:13.979 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[45319]: debug 2024-09-06T15:21:13.632+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:13.979 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[45319]: debug 2024-09-06T15:21:13.632+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:13.980 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[39614]: debug 2024-09-06T15:21:13.728+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:13.980 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[39614]: debug 2024-09-06T15:21:13.728+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:13.980 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:13 smithi190 bash[39614]: debug 2024-09-06T15:21:13.728+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:14.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[39614]: debug 2024-09-06T15:21:14.732+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:14.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[39614]: debug 2024-09-06T15:21:14.732+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:14.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[39614]: debug 2024-09-06T15:21:14.732+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:14.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[45319]: debug 2024-09-06T15:21:14.616+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:14.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[45319]: debug 2024-09-06T15:21:14.616+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:14.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:14 smithi190 bash[45319]: debug 2024-09-06T15:21:14.616+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:15.868 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[45319]: debug 2024-09-06T15:21:15.612+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:15.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[45319]: debug 2024-09-06T15:21:15.612+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:15.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[45319]: debug 2024-09-06T15:21:15.612+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:15.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[39614]: debug 2024-09-06T15:21:15.748+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:15.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[39614]: debug 2024-09-06T15:21:15.748+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:15.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:15 smithi190 bash[39614]: debug 2024-09-06T15:21:15.748+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:15.903 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.5.service' 2024-09-06T15:21:15.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:15.931 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-06T15:21:15.931 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-06T15:21:15.931 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.6 2024-09-06T15:21:16.369 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 systemd[1]: Stopping Ceph osd.6 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:16.369 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.108+0000 7f0d5c08d640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:21:16.369 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.108+0000 7f0d5c08d640 -1 osd.6 67 *** Got signal Terminated *** 2024-09-06T15:21:16.369 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.108+0000 7f0d5c08d640 -1 osd.6 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:21:16.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:16.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:16.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[39614]: debug 2024-09-06T15:21:16.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:16.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[45319]: debug 2024-09-06T15:21:16.596+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:16.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[45319]: debug 2024-09-06T15:21:16.596+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:16.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:16 smithi190 bash[45319]: debug 2024-09-06T15:21:16.596+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:17.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[39614]: debug 2024-09-06T15:21:17.792+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:17.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[39614]: debug 2024-09-06T15:21:17.792+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:17.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[39614]: debug 2024-09-06T15:21:17.792+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:17.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[45319]: debug 2024-09-06T15:21:17.624+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:17.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[45319]: debug 2024-09-06T15:21:17.624+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:17.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:17 smithi190 bash[45319]: debug 2024-09-06T15:21:17.624+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:18.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[39614]: debug 2024-09-06T15:21:18.828+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[39614]: debug 2024-09-06T15:21:18.828+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[39614]: debug 2024-09-06T15:21:18.828+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[45319]: debug 2024-09-06T15:21:18.604+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[45319]: debug 2024-09-06T15:21:18.604+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[45319]: debug 2024-09-06T15:21:18.604+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:18.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:18 smithi190 bash[45319]: debug 2024-09-06T15:21:18.604+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:19.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[39614]: debug 2024-09-06T15:21:19.816+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[39614]: debug 2024-09-06T15:21:19.816+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[39614]: debug 2024-09-06T15:21:19.816+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[45319]: debug 2024-09-06T15:21:19.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[45319]: debug 2024-09-06T15:21:19.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[45319]: debug 2024-09-06T15:21:19.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:19.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:19 smithi190 bash[45319]: debug 2024-09-06T15:21:19.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:20.868 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[39614]: debug 2024-09-06T15:21:20.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:28.135259+0000 front 2024-09-06T15:20:28.135648+0000 (oldest deadline 2024-09-06T15:20:52.835010+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[39614]: debug 2024-09-06T15:21:20.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:37.536147+0000 front 2024-09-06T15:20:37.536405+0000 (oldest deadline 2024-09-06T15:21:03.436090+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[39614]: debug 2024-09-06T15:21:20.788+0000 7f0d586a2640 -1 osd.6 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:46.937399+0000 front 2024-09-06T15:20:46.937625+0000 (oldest deadline 2024-09-06T15:21:11.637212+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[45319]: debug 2024-09-06T15:21:20.568+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[45319]: debug 2024-09-06T15:21:20.568+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[45319]: debug 2024-09-06T15:21:20.568+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:20.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:20 smithi190 bash[45319]: debug 2024-09-06T15:21:20.568+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:21.868 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:21 smithi190 bash[45319]: debug 2024-09-06T15:21:21.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:21.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:21 smithi190 bash[45319]: debug 2024-09-06T15:21:21.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:21.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:21 smithi190 bash[45319]: debug 2024-09-06T15:21:21.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:21.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:21 smithi190 bash[45319]: debug 2024-09-06T15:21:21.600+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:22.368 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[53990]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-6 2024-09-06T15:21:22.368 INFO:journalctl@ceph.osd.6.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[54054]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-6 2024-09-06T15:21:22.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[45319]: debug 2024-09-06T15:21:22.560+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:22.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[45319]: debug 2024-09-06T15:21:22.560+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:22.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[45319]: debug 2024-09-06T15:21:22.560+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:22.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:22 smithi190 bash[45319]: debug 2024-09-06T15:21:22.560+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:23.666 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:23 smithi190 bash[45319]: debug 2024-09-06T15:21:23.552+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:23.667 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:23 smithi190 bash[45319]: debug 2024-09-06T15:21:23.552+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:23.667 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:23 smithi190 bash[45319]: debug 2024-09-06T15:21:23.552+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:23.667 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:23 smithi190 bash[45319]: debug 2024-09-06T15:21:23.552+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:24.227 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.6.service' 2024-09-06T15:21:24.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:24.256 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-06T15:21:24.256 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-06T15:21:24.256 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.7 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 systemd[1]: Stopping Ceph osd.7 for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.432+0000 7f5917383640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.432+0000 7f5917383640 -1 osd.7 67 *** Got signal Terminated *** 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.432+0000 7f5917383640 -1 osd.7 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.516+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:24.507 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.516+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:24.868 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.516+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:24.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:24 smithi190 bash[45319]: debug 2024-09-06T15:21:24.516+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:25.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:25 smithi190 bash[45319]: debug 2024-09-06T15:21:25.500+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:25.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:25 smithi190 bash[45319]: debug 2024-09-06T15:21:25.500+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:25.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:25 smithi190 bash[45319]: debug 2024-09-06T15:21:25.500+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:25.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:25 smithi190 bash[45319]: debug 2024-09-06T15:21:25.500+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:25.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:25 smithi190 bash[45319]: debug 2024-09-06T15:21:25.500+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.190:6802 osd.4 since back 2024-09-06T15:21:04.029611+0000 front 2024-09-06T15:21:04.029701+0000 (oldest deadline 2024-09-06T15:21:25.129545+0000) 2024-09-06T15:21:26.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:26 smithi190 bash[45319]: debug 2024-09-06T15:21:26.524+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:26.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:26 smithi190 bash[45319]: debug 2024-09-06T15:21:26.524+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:26.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:26 smithi190 bash[45319]: debug 2024-09-06T15:21:26.524+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:26.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:26 smithi190 bash[45319]: debug 2024-09-06T15:21:26.524+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:26.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:26 smithi190 bash[45319]: debug 2024-09-06T15:21:26.524+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.190:6802 osd.4 since back 2024-09-06T15:21:04.029611+0000 front 2024-09-06T15:21:04.029701+0000 (oldest deadline 2024-09-06T15:21:25.129545+0000) 2024-09-06T15:21:27.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:27 smithi190 bash[45319]: debug 2024-09-06T15:21:27.540+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:27.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:27 smithi190 bash[45319]: debug 2024-09-06T15:21:27.540+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:27.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:27 smithi190 bash[45319]: debug 2024-09-06T15:21:27.540+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:27.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:27 smithi190 bash[45319]: debug 2024-09-06T15:21:27.540+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:27.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:27 smithi190 bash[45319]: debug 2024-09-06T15:21:27.540+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.190:6802 osd.4 since back 2024-09-06T15:21:04.029611+0000 front 2024-09-06T15:21:04.029701+0000 (oldest deadline 2024-09-06T15:21:25.129545+0000) 2024-09-06T15:21:28.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:28 smithi190 bash[45319]: debug 2024-09-06T15:21:28.584+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6803 osd.0 since back 2024-09-06T15:20:29.321577+0000 front 2024-09-06T15:20:29.321773+0000 (oldest deadline 2024-09-06T15:20:52.821570+0000) 2024-09-06T15:21:28.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:28 smithi190 bash[45319]: debug 2024-09-06T15:21:28.584+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6807 osd.1 since back 2024-09-06T15:20:36.823731+0000 front 2024-09-06T15:20:36.823908+0000 (oldest deadline 2024-09-06T15:21:00.323418+0000) 2024-09-06T15:21:28.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:28 smithi190 bash[45319]: debug 2024-09-06T15:21:28.584+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6811 osd.2 since back 2024-09-06T15:20:45.426113+0000 front 2024-09-06T15:20:45.425965+0000 (oldest deadline 2024-09-06T15:21:09.525866+0000) 2024-09-06T15:21:28.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:28 smithi190 bash[45319]: debug 2024-09-06T15:21:28.584+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.189:6815 osd.3 since back 2024-09-06T15:20:54.827347+0000 front 2024-09-06T15:20:54.827253+0000 (oldest deadline 2024-09-06T15:21:17.727200+0000) 2024-09-06T15:21:28.869 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:28 smithi190 bash[45319]: debug 2024-09-06T15:21:28.584+0000 7f5913998640 -1 osd.7 67 heartbeat_check: no reply from 172.21.15.190:6802 osd.4 since back 2024-09-06T15:21:04.029611+0000 front 2024-09-06T15:21:04.029701+0000 (oldest deadline 2024-09-06T15:21:25.129545+0000) 2024-09-06T15:21:30.618 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:30 smithi190 bash[54184]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-7 2024-09-06T15:21:30.619 INFO:journalctl@ceph.osd.7.smithi190.stdout:Sep 06 15:21:30 smithi190 bash[54247]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-osd-7 2024-09-06T15:21:32.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@osd.7.service' 2024-09-06T15:21:32.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:32.362 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-06T15:21:32.362 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-06T15:21:32.362 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@rgw.foo.a 2024-09-06T15:21:32.849 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:21:32 smithi189 systemd[1]: Stopping Ceph rgw.foo.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:32.849 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:21:32 smithi189 bash[53294]: debug 2024-09-06T15:21:32.520+0000 7f2bdcdb1640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-06T15:21:32.849 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:21:32 smithi189 bash[53294]: debug 2024-09-06T15:21:32.520+0000 7f2be061d880 -1 shutting down 2024-09-06T15:21:43.099 INFO:journalctl@ceph.rgw.foo.a.smithi189.stdout:Sep 06 15:21:43 smithi189 bash[67604]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-rgw-foo-a 2024-09-06T15:21:43.169 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@rgw.foo.a.service' 2024-09-06T15:21:43.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:43.190 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-06T15:21:43.190 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-06T15:21:43.191 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ceph-de31ad16-6c60-11ef-bce4-c7b262605968@prometheus.a 2024-09-06T15:21:43.508 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 systemd[1]: Stopping Ceph prometheus.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:43.508 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:964 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:988 level=info msg="Stopping scrape discovery manager..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:1002 level=info msg="Stopping notify discovery manager..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=manager.go:177 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:984 level=info msg="Scrape discovery manager stopped" 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:998 level=info msg="Notify discovery manager stopped" 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=manager.go:187 level=info component="rule manager" msg="Rule manager stopped" 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.351Z caller=main.go:1039 level=info msg="Stopping scrape manager..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.352Z caller=main.go:1031 level=info msg="Scrape manager stopped" 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.353Z caller=notifier.go:618 level=info component=notifier msg="Stopping notification manager..." 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.353Z caller=main.go:1261 level=info msg="Notifier manager stopped" 2024-09-06T15:21:43.509 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[52448]: ts=2024-09-06T15:21:43.353Z caller=main.go:1273 level=info msg="See you next time!" 2024-09-06T15:21:43.869 INFO:journalctl@ceph.prometheus.a.smithi190.stdout:Sep 06 15:21:43 smithi190 bash[54378]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-prometheus-a 2024-09-06T15:21:43.951 DEBUG:teuthology.orchestra.run.smithi190:> sudo pkill -f 'journalctl -f -n 0 -u ceph-de31ad16-6c60-11ef-bce4-c7b262605968@prometheus.a.service' 2024-09-06T15:21:43.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:21:43.977 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-06T15:21:43.977 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid de31ad16-6c60-11ef-bce4-c7b262605968 --force --keep-logs 2024-09-06T15:21:44.162 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:21:48.989 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:48.989 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:48 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.334 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.334 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.599 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.599 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.953 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:49.953 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:49 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.323 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.323 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.598 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.599 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:50.869 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:50 smithi189 systemd[1]: Stopping Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:50.869 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:50 smithi189 bash[60570]: ts=2024-09-06T15:21:50.800Z caller=main.go:542 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-06T15:21:51.708 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:51 smithi189 bash[68011]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-alertmanager-a 2024-09-06T15:21:51.709 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:51 smithi189 bash[68072]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-alertmanager-a 2024-09-06T15:21:51.709 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:51 smithi189 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-06T15:21:51.709 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:51 smithi189 systemd[1]: Stopped Ceph alertmanager.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:21:51.962 INFO:journalctl@ceph.alertmanager.a.smithi189.stdout:Sep 06 15:21:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:51.962 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:51 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:51.963 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:51 smithi189 systemd[1]: Stopping Ceph node-exporter.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:52.598 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 bash[68140]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-node-exporter-a 2024-09-06T15:21:52.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 bash[68201]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-node-exporter-a 2024-09-06T15:21:52.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-06T15:21:52.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-06T15:21:52.599 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 systemd[1]: Stopped Ceph node-exporter.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:21:52.979 INFO:journalctl@ceph.node-exporter.a.smithi189.stdout:Sep 06 15:21:52 smithi189 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:53.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid de31ad16-6c60-11ef-bce4-c7b262605968 --force --keep-logs 2024-09-06T15:21:53.448 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:21:58.303 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.304 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.304 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.560 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.561 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.561 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.819 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.820 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:58.820 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.073 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.073 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.073 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:58 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.369 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.369 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.869 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:21:59.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: Stopping Ceph iscsi.iscsi.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:21:59.869 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:21:59 smithi190 bash[49459]: debug Shutdown received 2024-09-06T15:21:59.870 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:21:59 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:10.369 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 bash[54714]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-iscsi-iscsi-a 2024-09-06T15:22:10.703 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:10.704 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:10.704 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-06T15:22:10.704 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 bash[54780]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-iscsi-iscsi-a 2024-09-06T15:22:10.704 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-06T15:22:10.705 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: Stopped Ceph iscsi.iscsi.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:22:10.705 INFO:journalctl@ceph.iscsi.iscsi.a.smithi190.stdout:Sep 06 15:22:10 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:11.744 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:11 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:11.745 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:11 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:12.105 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:11 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:12.106 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:11 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:12.106 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:11 smithi190 systemd[1]: Stopping Ceph node-exporter.b for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:22:12.813 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 bash[54981]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-node-exporter-b 2024-09-06T15:22:12.813 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-06T15:22:12.813 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 bash[55041]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-node-exporter-b 2024-09-06T15:22:12.813 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-06T15:22:12.813 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 systemd[1]: Stopped Ceph node-exporter.b for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:22:13.119 INFO:journalctl@ceph.node-exporter.b.smithi190.stdout:Sep 06 15:22:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:13.119 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:12 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:13.119 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 systemd[1]: Stopping Ceph grafana.a for de31ad16-6c60-11ef-bce4-c7b262605968... 2024-09-06T15:22:13.403 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[51708]: logger=server t=2024-09-06T15:22:13.149622653Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-09-06T15:22:13.403 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[51708]: logger=tracing t=2024-09-06T15:22:13.149717317Z level=info msg="Closing tracing" 2024-09-06T15:22:13.403 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[51708]: logger=ticker t=2024-09-06T15:22:13.149713057Z level=info msg=stopped last_tick=2024-09-06T15:22:10Z 2024-09-06T15:22:13.403 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[51708]: logger=grafana-apiserver t=2024-09-06T15:22:13.149824506Z level=info msg="StorageObjectCountTracker pruner is exiting" 2024-09-06T15:22:13.403 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[51708]: logger=sqlstore.transactions t=2024-09-06T15:22:13.161316978Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-06T15:22:14.050 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[55108]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-grafana-a 2024-09-06T15:22:14.051 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 bash[55169]: Error response from daemon: No such container: ceph-de31ad16-6c60-11ef-bce4-c7b262605968-grafana-a 2024-09-06T15:22:14.051 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 systemd[1]: ceph-de31ad16-6c60-11ef-bce4-c7b262605968@grafana.a.service: Deactivated successfully. 2024-09-06T15:22:14.051 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:13 smithi190 systemd[1]: Stopped Ceph grafana.a for de31ad16-6c60-11ef-bce4-c7b262605968. 2024-09-06T15:22:14.051 INFO:journalctl@ceph.grafana.a.smithi190.stdout:Sep 06 15:22:14 smithi190 systemd[1]: /etc/systemd/system/ceph-de31ad16-6c60-11ef-bce4-c7b262605968@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-09-06T15:22:14.607 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:22:14.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:22:14.634 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-06T15:22:14.636 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi189/crash 2024-09-06T15:22:14.637 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash -- . 2024-09-06T15:22:14.677 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash: Cannot open: No such file or directory 2024-09-06T15:22:14.677 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-06T15:22:14.680 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi190/crash 2024-09-06T15:22:14.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash -- . 2024-09-06T15:22:14.692 INFO:teuthology.orchestra.run.smithi190.stderr:tar: /var/lib/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/crash: Cannot open: No such file or directory 2024-09-06T15:22:14.692 INFO:teuthology.orchestra.run.smithi190.stderr:tar: Error is not recoverable: exiting now 2024-09-06T15:22:14.693 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-06T15:22:14.694 DEBUG:teuthology.orchestra.run.smithi189:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v CEPHADM_STRAY_DAEMON | head -n 1 2024-09-06T15:22:14.737 INFO:tasks.cephadm:Compressing logs... 2024-09-06T15:22:14.738 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-06T15:22:14.783 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-06T15:22:14.790 INFO:teuthology.orchestra.run.smithi189.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-06T15:22:14.795 INFO:teuthology.orchestra.run.smithi190.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-06T15:22:14.800 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.y.log 2024-09-06T15:22:14.800 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.0.log 2024-09-06T15:22:14.800 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.2.log 2024-09-06T15:22:14.801 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.a.log 2024-09-06T15:22:14.801 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log 2024-09-06T15:22:14.801 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.3.log 2024-09-06T15:22:14.802 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.1.log 2024-09-06T15:22:14.804 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log 88.9% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log.gz 2024-09-06T15:22:14.804 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-06T15:22:14.804 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log 2024-09-06T15:22:14.804 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.c.log 2024-09-06T15:22:14.806 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.7.log 2024-09-06T15:22:14.808 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log: 93.3% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log.gz 2024-09-06T15:22:14.808 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log 2024-09-06T15:22:14.808 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.6.log 2024-09-06T15:22:14.808 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log 2024-09-06T15:22:14.808 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.5.log 2024-09-06T15:22:14.809 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/tcmu-runner.log 2024-09-06T15:22:14.809 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log: /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.x.log 2024-09-06T15:22:14.809 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/tcmu-runner.log: 63.1% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/tcmu-runner.log.gz 2024-09-06T15:22:14.810 INFO:teuthology.orchestra.run.smithi190.stderr: 79.0% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.cephadm.log.gz 2024-09-06T15:22:14.810 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log 2024-09-06T15:22:14.811 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log 2024-09-06T15:22:14.811 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log 2024-09-06T15:22:14.811 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.b.log 2024-09-06T15:22:14.811 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.4.log 2024-09-06T15:22:14.812 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.b.log: 88.4% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.log.gz 2024-09-06T15:22:14.812 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-06T15:22:14.814 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.4.log: 90.3% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log.gz 2024-09-06T15:22:14.818 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-client.rgw.foo.a.log 2024-09-06T15:22:14.821 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/cephadm.log: 90.4% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.x.log.gz 2024-09-06T15:22:14.823 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph.audit.log.gz 2024-09-06T15:22:14.823 INFO:teuthology.orchestra.run.smithi189.stderr: 90.7% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log.gz 2024-09-06T15:22:14.824 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-06T15:22:14.826 INFO:teuthology.orchestra.run.smithi190.stderr: 90.7% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-volume.log.gz 2024-09-06T15:22:14.831 INFO:teuthology.orchestra.run.smithi190.stderr: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-06T15:22:14.857 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-client.rgw.foo.a.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-06T15:22:14.857 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-client.rgw.foo.a.log.gz 2024-09-06T15:22:15.007 INFO:teuthology.orchestra.run.smithi189.stderr: 89.4% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mgr.y.log.gz 2024-09-06T15:22:15.067 INFO:teuthology.orchestra.run.smithi190.stderr: 92.2% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.b.log.gz 2024-09-06T15:22:15.087 INFO:teuthology.orchestra.run.smithi189.stderr: 92.2% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.c.log.gz 2024-09-06T15:22:15.153 INFO:teuthology.orchestra.run.smithi189.stderr: 93.0% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.0.log.gz 2024-09-06T15:22:15.186 INFO:teuthology.orchestra.run.smithi190.stderr: 92.7% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.6.log.gz 2024-09-06T15:22:15.192 INFO:teuthology.orchestra.run.smithi190.stderr: 93.2% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.7.log.gz 2024-09-06T15:22:15.203 INFO:teuthology.orchestra.run.smithi189.stderr: 92.7% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.2.log.gz 2024-09-06T15:22:15.223 INFO:teuthology.orchestra.run.smithi190.stderr: 93.0% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.5.log.gz 2024-09-06T15:22:15.248 INFO:teuthology.orchestra.run.smithi190.stderr: 92.9% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.4.log.gz 2024-09-06T15:22:15.250 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-09-06T15:22:15.250 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m0.463s 2024-09-06T15:22:15.250 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m1.833s 2024-09-06T15:22:15.250 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.112s 2024-09-06T15:22:15.259 INFO:teuthology.orchestra.run.smithi189.stderr: 93.0% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.1.log.gz 2024-09-06T15:22:15.328 INFO:teuthology.orchestra.run.smithi189.stderr: 92.9% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-osd.3.log.gz 2024-09-06T15:22:15.411 INFO:teuthology.orchestra.run.smithi189.stderr: 90.6% -- replaced with /var/log/ceph/de31ad16-6c60-11ef-bce4-c7b262605968/ceph-mon.a.log.gz 2024-09-06T15:22:15.412 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-06T15:22:15.412 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m0.628s 2024-09-06T15:22:15.412 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m2.781s 2024-09-06T15:22:15.412 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.128s 2024-09-06T15:22:15.413 INFO:tasks.cephadm:Archiving logs... 2024-09-06T15:22:15.413 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi189/log 2024-09-06T15:22:15.414 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-06T15:22:15.799 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi190/log 2024-09-06T15:22:15.800 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-06T15:22:16.046 INFO:tasks.cephadm:Removing cluster... 2024-09-06T15:22:16.046 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid de31ad16-6c60-11ef-bce4-c7b262605968 --force 2024-09-06T15:22:16.224 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:22:17.576 DEBUG:teuthology.orchestra.run.smithi190:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid de31ad16-6c60-11ef-bce4-c7b262605968 --force 2024-09-06T15:22:17.762 INFO:teuthology.orchestra.run.smithi190.stdout:Deleting cluster with fsid: de31ad16-6c60-11ef-bce4-c7b262605968 2024-09-06T15:22:19.108 INFO:tasks.cephadm:Removing cephadm ... 2024-09-06T15:22:19.108 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-06T15:22:19.114 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-06T15:22:19.120 INFO:tasks.cephadm:Teardown complete 2024-09-06T15:22:19.120 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephadm.py", line 2371, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-06T15:22:19.360 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=111643196c7e4374bbfd00372eeadb16 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephadm.py", line 2371, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph.py", line 1537, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_manager.py", line 3299, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2024-09-06T15:22:19.363 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-06T15:22:19.372 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-06T15:22:19.392 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-06T15:22:19.393 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-06T15:22:19.413 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-06T15:22:19.497 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-06T15:22:19.505 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-06T15:22:19.506 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T15:22:19.508 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout:*hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.113 -6.407 0.604 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.129 -4.078 0.603 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.078 -5.674 0.813 2024-09-06T15:22:19.520 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-06T15:22:19.522 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-09-06T15:22:19.522 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-09-06T15:22:19.522 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 67.205.162.81 3 u 5 64 377 0.099 -11.219 1.120 2024-09-06T15:22:19.522 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.072 -6.352 2.820 2024-09-06T15:22:19.522 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 55 64 377 0.085 -11.084 2.048 2024-09-06T15:22:19.523 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-09-06T15:22:19.523 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-06T15:22:19.531 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-06T15:22:19.531 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-06T15:22:19.539 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-06T15:22:19.547 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-06T15:22:19.555 INFO:teuthology.task.internal:Duration was 1827.217295 seconds 2024-09-06T15:22:19.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-06T15:22:19.563 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-06T15:22:19.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-06T15:22:19.566 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-06T15:22:19.601 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-06T15:22:19.601 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-06T15:22:19.601 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-06T15:22:19.651 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-09-06T15:22:19.651 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-06T15:22:19.660 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-06T15:22:19.661 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-06T15:22:19.694 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-06T15:22:19.746 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-06T15:22:19.746 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-06T15:22:19.749 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-06T15:22:19.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-06T15:22:19.918 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-06T15:22:19.918 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-06T15:22:19.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-06T15:22:19.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-06T15:22:19.951 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:22:19.974 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:22:19.982 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-06T15:22:19.994 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-09-06T15:22:20.018 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:22:20.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:22:20.053 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:22:20.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:22:20.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-06T15:22:20.074 INFO:teuthology.task.internal:Transferring archived files... 2024-09-06T15:22:20.075 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi189 2024-09-06T15:22:20.075 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-06T15:22:20.125 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892417/remote/smithi190 2024-09-06T15:22:20.125 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-06T15:22:20.150 INFO:teuthology.task.internal:Removing archive directory... 2024-09-06T15:22:20.150 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-06T15:22:20.163 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-06T15:22:20.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-06T15:22:20.210 INFO:teuthology.task.internal:Not uploading archives. 2024-09-06T15:22:20.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-06T15:22:20.219 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-06T15:22:20.220 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-06T15:22:20.222 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-06T15:22:20.225 INFO:teuthology.orchestra.run.smithi189.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 6 15:22 /home/ubuntu/cephtest 2024-09-06T15:22:20.247 INFO:teuthology.orchestra.run.smithi190.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 6 15:22 /home/ubuntu/cephtest 2024-09-06T15:22:20.248 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-06T15:22:20.258 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-06T15:22:20.279 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} duration: 1827.217295408249 failure_reason: timeout expired in wait_until_healthy flavor: default owner: scheduled_adking@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=111643196c7e4374bbfd00372eeadb16 status: fail success: false 2024-09-06T15:22:20.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-06T15:22:20.355 INFO:teuthology.run:FAIL